WU Jingdi
d1ee1ba56a
feat: support set timezone in db ( #2992 )
...
* feat: support set timezone in db
* chore: fix ci
* chore: fix code advice
* fix: rename `time_zone` to `timezone`
2023-12-27 09:19:39 +00:00
Ning Sun
feec4e289d
feat: upgrade pgwire to 0.18 for corrected statement caching ( #3010 )
2023-12-27 03:02:25 +00:00
LFC
eadde72973
chore: "fix: revert unfinished route table change" ( #3009 )
...
Revert "fix: revert unfinished route table change (#3008 )"
This reverts commit 8ce8a8f3c7 .
2023-12-27 02:40:59 +00:00
Ruihang Xia
8ce8a8f3c7
fix: revert unfinished route table change ( #3008 )
...
* Revert "refactor: hide `RegionRoute` behind `TableRouteValue` (#2989 )"
This reverts commit 1641fd572a .
* Revert "feat: MetricsEngine table route (part 1) (#2952 )"
This reverts commit 6ac47e939c .
2023-12-26 09:56:49 +00:00
Ruihang Xia
bf635a6c7c
feat: replace ahash with murmur3 on generating tsid ( #3007 )
...
* feat: replace ahash with murmur3 on generating tsid
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* change random seed
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-12-26 07:45:31 +00:00
tison
417be13400
feat: adopt human-panic crash reports ( #2996 )
...
* feat: adopt human-panic crash reports
Signed-off-by: tison <wander4096@gmail.com >
* build: fix dep toml conflict
Signed-off-by: tison <wander4096@gmail.com >
---------
Signed-off-by: tison <wander4096@gmail.com >
2023-12-25 13:23:18 +00:00
Ruihang Xia
0a9ad004a4
chore: bump version to 0.5.0 ( #3000 )
...
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-12-25 13:14:59 +00:00
SSebo
cf561df854
feat: export runtime metric to promethues ( #2985 )
...
* feat: export runtime metric to promethues
* fix: export tokio metric should enable tokio_unstable
* chore: tokio-metric export add more check info
2023-12-25 12:47:22 +00:00
LFC
1641fd572a
refactor: hide RegionRoute behind TableRouteValue ( #2989 )
...
* refactor: hide `RegionRoute` behind `TableRouteValue` (Metric Engine table route, part 2)
* Update src/common/meta/src/ddl/create_table.rs
Co-authored-by: Weny Xu <wenymedia@gmail.com >
* Update src/meta-srv/src/procedure/region_migration/test_util.rs
Co-authored-by: Weny Xu <wenymedia@gmail.com >
* fix: resolve PR comments
* fix: rustfmt
* compatible with the old TableRouteValue
* Update src/common/meta/src/key/table_route.rs
Co-authored-by: Weny Xu <wenymedia@gmail.com >
---------
Co-authored-by: Weny Xu <wenymedia@gmail.com >
2023-12-25 11:37:50 +00:00
niebayes
7d509e97f6
chore: move some commonly referenced crates to workspace Cargo.toml ( #2981 )
...
fix: resolve conflicts
2023-12-22 09:13:18 +00:00
niebayes
830a91c548
feat(remote_wal): implement topic allocation ( #2970 )
...
* chore: implement wal options allocator
* chore: implement round-robin topic selector
* feat: add shuffle to round-robin topic selector
* chore: implement kafka topic manager
* test: add tests for wal options allocator
* test: add wal provider to test config files
* test: leave todos for adding tests for remote wal
* fix: resolve review conversations
* fix: typo
2023-12-22 08:26:48 +00:00
WU Jingdi
675767c023
feat: Support export metric in remote write format ( #2928 )
...
* feat: remote write metric task
* chore: pass stanalone task to frontend
* chore: change name to system metric
* fix: add header and rename to export metrics
2023-12-22 02:09:12 +00:00
dennis zhuang
054bca359e
feat: adds build_info table ( #2969 )
2023-12-21 12:28:09 +00:00
niebayes
9da1f236d9
feat(remote_wal): add skeleton for remote wal related to datanode ( #2941 )
...
* refactor: refactor wal config
* test: update tests related to wal
* feat: introduce kafka wal config
* chore: augment proto with wal options
* feat: augment region open request with wal options
* feat: augment mito region with wal options
* feat: augment region create request with wal options
* refactor: refactor log store trait
* feat: add skeleton for kafka log store
* feat: generalize building log store when starting datanode
* feat: integrate wal options to region write
* chore: minor update
* refactor: remove wal options from region create/open requests
* fix: compliation issues
* chore: insert wal options into region options upon initializing region server
* chore: integrate wal options into region options
* chore: fill in kafka wal config
* chore: reuse namespaces while writing to wal
* chore: minor update
* chore: fetch wal options from region while handling truncate/flush
* fix: region options test
* fix: resolve some review conversations
* refactor: serde with wal options
* fix: resolve some review conversations
2023-12-20 09:01:17 +00:00
niebayes
839e653e0d
feat(remote_wal): add skeleton for remote wal related to meta srv ( #2933 )
...
* feat: introduce wal config and kafka config
* feat: introduce kafka topic manager and selector
* feat: introduce region wal options
* chore: build region wal options upon starting meta srv
* feat: integrate region wal options allocator into table meta allocator
* chore: add wal config to metasrv.example.toml
* chore: add region wal options map to create table procedure
* feat: augment region create request with wal options
* feat: augment DatanodeTableValue with region wal options map
* chore: encode region wal options upon constructing table creator
* feat: persist region wal options when creating table meta
* fix: sqlness test
* chore: set default wal provider to raft-engine
* refactor: refactor wal options
* chore: update wal options allocator
* refactor: rename region wal options to wal options
* chore: update usages of region wal options
* chore: add some comments to kafka
* chore: fill in kafka config
* test: add tests for serde wal config
* test: add tests for wal options
* refactor: refactor wal options allocator to enum
* refactor: store wal options into the request options instead
* fix: typo
* fix: typo
* refactor: move wal options map to region info
* refactor: refacto serialization and deserialization of wal options
* refactor: use serde_json to encode wal options
* chore: rename wal_options_map to region_wal_options
* chore: resolve some review comments
* fix: typo
* refactor: replace kecab-case with snake_case
* fix: sqlness and converage tests
* fix: typo
* fix: coverage test
* fix: coverage test
* chore: resolve some review conversations
* fix: resolve some review conversations
* chore: format comments in metasrv.example.toml
* chore: update import style
* feat: integrate wal options allocator to standalone mode
* test: add compatible test for OpenRegion
* test: add compatible test for UpdateRegionMetadata
* chore: remove based suffix from topic selector type
2023-12-19 12:43:47 +00:00
LFC
c7b36779c1
fix: correctly decode mysql timestamp binary value ( #2946 )
...
* fix: correctly decode mysql timestamp binary value
* fix: ut
* fix: resolve PR comments
2023-12-19 11:05:28 +00:00
Zhenchi
83de399bef
feat(inverted_index.create): add external sorter ( #2950 )
...
* feat(inverted_index.create): add read/write for external intermediate files
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: MAGIC_CODEC_V1 -> CODEC_V1_MAGIC
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: polish comments
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: fix typos intermedia -> intermediate
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: typos
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* feat(inverted_index.create): add external sorter
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: fix typos intermedia -> intermediate
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: polish comments
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: polish comments
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* refactor: drop the stream as early as possible to avoid recursive calls to poll
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* refactor: project merge sorted stream
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* feat: add total_row_count to SortOutput
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* feat: remove change of format
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* refactor: rename segment null bitmap
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* refactor: test type alias
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* feat: allow `memory_usage_threshold` to be None to turn off dumping
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* feat: change segment_row_count type to NonZeroUsize
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* refactor: accept BytesRef instead
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* feat: add `push_n` to adapt mito2
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: add k-way merge TODO
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* refactor: more sorter cases
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* refactor: make the merge tree balance
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* Update src/index/src/inverted_index/create/sort/external_sort.rs
Co-authored-by: Yingwen <realevenyag@gmail.com >
* chore: address comments
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: stable feature
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
---------
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
Co-authored-by: Yingwen <realevenyag@gmail.com >
2023-12-19 08:14:37 +00:00
Zhenchi
d339191e29
refactor: remove reduntant .compat() ( #2949 )
...
* refactor: remove reduntant `.compat()`
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* remove dep
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
---------
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
2023-12-18 10:36:45 +00:00
Zhenchi
029ff2f1e3
feat(inverted_index.create): add read/write for external intermediate files ( #2942 )
...
* feat(inverted_index.create): add read/write for external intermediate files
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: MAGIC_CODEC_V1 -> CODEC_V1_MAGIC
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: polish comments
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: fix typos intermedia -> intermediate
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: typos
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: futures_code -> asynchronous_codec
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: bump bytes to 1.5
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
---------
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
2023-12-18 09:44:48 +00:00
Ruihang Xia
9af9c0229a
feat: create table procedure for metric engine, part 1 ( #2943 )
...
* implementation
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* initialize
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* remove empty file
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* apply review sugg
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-12-18 08:03:28 +00:00
dennis zhuang
262a79a170
feat: adds some tables to information_schema ( #2935 )
...
* feat: adds engines table to information_schema
* feat: adds COLUMN_PRIVILEGES and COLUMN_STATISTICS
* feat: refactor memory tables
* chore: rename memory_tables
* test: adds unit tests
* chore: format
* chore: style
* fix: by cr comments
* refactor: tables
2023-12-18 06:10:22 +00:00
Wei
5dc7ce1791
fix: typos and bit operations ( #2944 )
...
* fix: typos and bit operation
* fix: helper
* chore: add tests in decimal128.rs and interval.rs
* chore: test
* chore: change proto version
* chore: clippy
2023-12-18 03:06:11 +00:00
Ning Sun
39f80876cd
feat: upgrade rustls library family, opensrv-mysql and pgwire ( #2927 )
...
* feat: deps up
* fmt: toml format
2023-12-14 05:56:39 +00:00
Yue Deng
3d651522c2
feat: add build() function to return the database build info ( #2919 )
...
* feat: add build function and register it
build() function to return the database build info #2909
* refactor: fix typos and change code structure
* test: add test for build()
* refactor: cargo fmt and eliminate warnings
* Apply suggestions from code review
Co-authored-by: Weny Xu <wenymedia@gmail.com >
* refactor: move system.sql to a new directory
---------
Co-authored-by: Weny Xu <wenymedia@gmail.com >
2023-12-13 09:02:00 +00:00
Weny Xu
cf6bba09fd
refactor: use downgrading the region instead of closing region ( #2863 )
...
* refactor: use downgrading the region instead of closing region
* feat: enhance the tests for alive keeper
* feat: add a metric to track region lease expired
* chore: apply suggestions from CR
* chore: enable logging for test_distributed_handle_ddl_request
* refactor: simplify lease keeper
* feat: add metrics for lease keeper
* chore: apply suggestions from CR
* chore: apply suggestions from CR
* chore: apply suggestions from CR
* refactor: move OpeningRegionKeeper to common_meta
* feat: register operating regions to MemoryRegionKeeper
2023-12-12 09:24:17 +00:00
Yingwen
6a57f4975e
perf(mito): scan SSTs and memtables in parallel ( #2852 )
...
* feat: seq scan support parallelism
* feat: scan region by parallelism in config
* feat: enlarge channel size
* chore: parallel builder logs
* feat: use parallel reader accroding to source num
* chore: 128 channel size
* feat: add fetch cost metrics
* feat: add channel size to config
* feat: builder cost
* feat: logs
* feat: compiler error
* feat: fetch cost
* feat: convert cost
* chore: Revert "feat: logs"
This reverts commit 01e0df2c3a .
* chore: fix compiler errors
* feat: reduce channel size to 32
* chore: use workspace tokio-stream
* test: test scan in parallel
* chore: comment typos
* refactor: build all sources first
* test: test 0 parallelism
* feat: use parallel scan by default
* docs: update config example
* feat: log parallelism
* refactor: keep config in engine inner
* refactor: rename parallelism method
* docs: update docs
* test: fix config api test
* docs: update parallel scan comment
* feat: 0 for default parallelism
2023-12-11 06:43:17 +00:00
Zhenchi
0b421b5177
feat(inverted_index.search): add index applier ( #2868 )
...
* feat(inverted_index.search): add fst applier
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: typos
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* feat(inverted_index.search): add fst values mapper
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: remove meta check
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: fmt & clippy
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* refactor: one expect for test
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* feat(inverted_index.search): add index applier
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* refactor: bitmap_full -> bitmap_full_range
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* feat: add check for segment_row_count
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: remove redundant code
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: reader test
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: match error in test
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: fmt
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* refactor: add helper function to construct fst value
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* refactor: polish unit tests
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* refactor: bytemuck to extract offset and size
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: toml format
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* refactor: use bytemuck
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* refactor: reorg value in unit tests
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: update proto
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: add a TODO reminder to consider optimizing the order of apply
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* refactor: InList predicates are applied first to benefit from higher selectivity
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: update proto
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* feat: add read options to control the behavior of index not found
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* refactor: polish
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* refactor: move read options to implementation instead of trait
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* feat: add SearchContext, refine doc comments
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* feat: move index_not_found_strategy as a field of SearchContext
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: rename varient
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
---------
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
2023-12-05 08:24:24 +00:00
WU Jingdi
aa89d9deef
fix: replace opendal PrometheusLayer ( #2861 )
...
* fix: replace opendal `PrometheusLayer`
* chore: add docs on `PrometheusMetricsLayer`
* chore: fix code advice
* chore: fix bug on `PrometheusMetricsLayer`
2023-12-05 07:15:45 +00:00
tison
7d506b3c5f
feat: drop if exists ( #2859 )
...
* feat: drop if exists
Signed-off-by: tison <wander4096@gmail.com >
* sqlness cases
Signed-off-by: tison <wander4096@gmail.com >
---------
Signed-off-by: tison <wander4096@gmail.com >
2023-12-05 02:18:33 +00:00
Zhenchi
a9db80ab1a
feat(inverted_index.search): add fst values mapper ( #2862 )
...
* feat(inverted_index.search): add fst applier
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: typos
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* feat(inverted_index.search): add fst values mapper
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: remove meta check
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: fmt & clippy
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* refactor: one expect for test
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: match error in test
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: fmt
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* refactor: add helper function to construct fst value
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* refactor: bytemuck to extract offset and size
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: toml format
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
---------
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
2023-12-04 13:29:02 +00:00
Zhenchi
58c13739f0
feat(inverted_index.search): add fst applier ( #2851 )
...
* feat(inverted_index.search): add fst applier
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: typos
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
---------
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
2023-12-04 09:21:09 +00:00
WU Jingdi
806400caff
feat: add align to / interval support in range query ( #2842 )
...
* feat: add align to / interval support in range query
* chore: fix ci
* chore: simplify `parse_duration_expr`
* chore: change s to ms
2023-12-04 08:00:41 +00:00
Weny Xu
616eb04914
chore: bump version to 0.4.4 ( #2840 )
...
chore: bump to v0.4.4
2023-11-29 08:59:42 +00:00
fys
707a0d5626
fix: urldecode when influxdb auth ( #2831 )
...
* fix: add url decode when influxdb auth
* chore: fmt toml
2023-11-28 09:35:03 +00:00
Zhenchi
b3edbef1f3
feat(inverted_index): add index reader ( #2803 )
...
* feat(inverted_index): add reader
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: toml format
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: add prefix relative_ to the offset parameter
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* docs: add doc comment
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: update proto
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: outdated docs
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
---------
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
2023-11-27 03:31:44 +00:00
Wei
3a4c9f2b45
feat: supports decimal type in RPC ( #2788 )
...
* refactor: ColumnDataTypeWrapper
* feat: decimal128 grpc
* feat: add test case
* chore: add TODO
* chore: empty line
* chore: remove precision and scale
* refactor: remove precision and scale
* chore: remove sqlness test
* chore: rename
* chore: proto version
* chore: cr comment.
Co-authored-by: Yingwen <realevenyag@gmail.com >
* Update src/mito2/src/memtable/time_series.rs
Co-authored-by: Yingwen <realevenyag@gmail.com >
---------
Co-authored-by: Yingwen <realevenyag@gmail.com >
2023-11-24 09:19:33 +00:00
Ning Sun
85eebcb16f
fix: correct mysql timestamp encoding for binary protocol ( #2797 )
...
* fix: correct mysql timestamp encoding for binary protocol
* test: add tests for mysql timestamp encoding
2023-11-23 18:54:59 +00:00
tison
102e43aace
test: use EtcdStore in IT cases ( #2734 )
...
* test: use EtcdStore in IT cases
Signed-off-by: tison <wander4096@gmail.com >
* retrigger CI
Signed-off-by: tison <wander4096@gmail.com >
* refactor: KvPair can take etcd KeyValue
Signed-off-by: tison <wander4096@gmail.com >
* temporary use fork
Signed-off-by: tison <wander4096@gmail.com >
* drop cloned
Signed-off-by: tison <wander4096@gmail.com >
* chroot_key_value
Signed-off-by: tison <wander4096@gmail.com >
* chroot and prepend in each point
Signed-off-by: tison <wander4096@gmail.com >
* adjust call points
Signed-off-by: tison <wander4096@gmail.com >
* cargo clippy
Signed-off-by: tison <wander4096@gmail.com >
* point to upstream etcd-client
Signed-off-by: tison <wander4096@gmail.com >
* test etcd chroot
Signed-off-by: tison <wander4096@gmail.com >
* add NO_CHROOT constant
Signed-off-by: tison <wander4096@gmail.com >
* check
Signed-off-by: tison <wander4096@gmail.com >
* handle range end
Signed-off-by: tison <wander4096@gmail.com >
* handle special encoded key or range_end
Signed-off-by: tison <wander4096@gmail.com >
* fixup implementation
Signed-off-by: tison <wander4096@gmail.com >
* clippy
Signed-off-by: tison <wander4096@gmail.com >
* avoid test name conflict
Signed-off-by: tison <wander4096@gmail.com >
* chroot to kvbackend level
Signed-off-by: tison <wander4096@gmail.com >
* fixup all occurances
Signed-off-by: tison <wander4096@gmail.com >
* fix type
Signed-off-by: tison <wander4096@gmail.com >
* Update src/common/meta/src/kv_backend/txn.rs
* make github happy
---------
Signed-off-by: tison <wander4096@gmail.com >
Co-authored-by: LFC <990479+MichaelScofield@users.noreply.github.com >
2023-11-23 05:47:00 +00:00
tison
efc5abfc02
build: upgrade etcd-client to 0.12.2 ( #2781 )
...
* build: upgrade etcd-client to 0.12.2
Signed-off-by: tison <wander4096@gmail.com >
* upgrade nightly toolchain
Signed-off-by: tison <wander4096@gmail.com >
* chore: run clippy
Signed-off-by: tison <wander4096@gmail.com >
* Update Cargo.toml
Co-authored-by: tison <wander4096@gmail.com >
---------
Signed-off-by: tison <wander4096@gmail.com >
Co-authored-by: Ning Sun <classicning@gmail.com >
2023-11-21 06:33:41 +00:00
Ruihang Xia
20f01219e9
refactor: adjust metric engine structure ( #2773 )
...
* extract consts into a separate mod
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add documents
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* split state
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* split create
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* split alter
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* split put
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix metadata clippy
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix engine clippy
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix typo
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-11-21 05:21:22 +00:00
Yingwen
b9146c88ff
refactor: Remove usages of the old storage crate ( #2777 )
...
* chore: remove storage from some crate
* feat: remove storage config
* feat: remove storage from cmd
* feat: impl stream_to_parquet
* feat: remove storage from operator
* feat: remove stream writer from mito2
* feat: remove storage from project toml
* test: fix config api test
* docs: remove outdated configs
* refactor: remove storage directory
2023-11-20 20:29:41 +08:00
Bruce Chen
9558b3c201
build(cmd): upgrade clap to 4.x ( #2775 )
...
* build(cmd): upgrade clap to 4.4.8
* build(cmd): upgrade clap to 4.4
2023-11-20 10:43:31 +00:00
fys
da68d8ce4b
feat: add random weighted choose in load_based selector ( #2234 )
...
* feat: add random weigted choose in load_based selector
* fix: meta cannot save heartbeats when cluster have no region
* chore: print some log
* chore: remove unused code
* cr
* add some logs when filter result is empty
2023-11-20 06:47:42 +00:00
Zhenchi
d9eeeee06e
feat(puffin): add file reader ( #2751 )
...
* feat(puffin): add file reader
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: toml format
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: rename PuffinParser to PuffinFileReader
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: polish comments
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* Update src/puffin/src/file_format/reader/footer.rs
Co-authored-by: Yingwen <realevenyag@gmail.com >
* Update src/puffin/src/file_format/reader/file.rs
Co-authored-by: Yingwen <realevenyag@gmail.com >
* Update src/puffin/src/file_format/reader/footer.rs
Co-authored-by: Yingwen <realevenyag@gmail.com >
* Update src/puffin/src/file_format/reader/footer.rs
Co-authored-by: Yingwen <realevenyag@gmail.com >
* fix: check file size
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: redundant type cast
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: reuse read buffer
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: check payload size
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: check payload size
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: validate blob offset
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: validate blob offset
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
---------
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
Co-authored-by: Yingwen <realevenyag@gmail.com >
2023-11-20 04:29:41 +00:00
WU Jingdi
500e299e40
feat: Enable distributed tracing in greptimedb ( #2755 )
...
* feat: implement distributed tracing
* fix: change usage of span
* fix: use otlp as exporter
* chore: update dependence
* chore: add span info
* chore: add alias
* chore: use instrument instead of trace
2023-11-17 08:51:57 +00:00
Ruihang Xia
ac4b6cd7f0
feat: write logical region to metric engine ( #2759 )
...
* transform write request
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add tests for put request
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* use table_id instead of metric_name
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix typo
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* CR sugg.
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* define random state as const
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-11-17 07:44:11 +00:00
Lei, HUANG
e083b8011c
chore: bump greptimedb version v0.4.3 ( #2766 )
2023-11-17 06:12:37 +00:00
Yingwen
142035340d
fix: compiler errors under non-default features ( #2761 )
...
* feat: bump prost and fix pprof feature compiler errors
* feat: fix compiler errors on tokio-console
* chore: fix compiler errors
* ci: add all features check to ci
2023-11-16 19:43:44 +00:00
Wei
ae27fbc7f2
feat: impl Vector, DataType traits for decimal128 ( #2727 )
...
* feat: decimal128 vector
* feat: Decimal128Type in datatypes
* refactor: cast function
* feat: decimal128 type in ConcreteDataType
* chore: decimal
* chore: sql_data_type_to_concrete_data_type
* chore: cr comment
Co-authored-by: Dennis Zhuang <killme2008@gmail.com >
Co-authored-by: Yingwen <realevenyag@gmail.com >
* chore: fix finish()
* chore: add debug_assert to new decimal128
---------
Co-authored-by: Dennis Zhuang <killme2008@gmail.com >
Co-authored-by: Yingwen <realevenyag@gmail.com >
2023-11-16 06:44:26 +00:00
Zhenchi
3329da5b72
feat(puffin): add partial reader ( #2741 )
...
* feat(puffin): add partial reader
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* address comment
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
---------
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
2023-11-15 06:28:20 +00:00