jeremyhi
12648f388a
feat: refactor grpc options of metasrv ( #6275 )
...
* feat: refactor grpc options of metasrv
* fix: unit test
* feat: config update
2025-06-10 01:35:57 +00:00
dennis zhuang
0311db3089
fix: export metrics settings in sample config ( #6170 )
...
* fix: export metrics settings in sample config
Signed-off-by: Dennis Zhuang <killme2008@gmail.com >
* chore: forgot update docs
Signed-off-by: Dennis Zhuang <killme2008@gmail.com >
* fix: test loading example configs
Signed-off-by: Dennis Zhuang <killme2008@gmail.com >
---------
Signed-off-by: Dennis Zhuang <killme2008@gmail.com >
2025-06-09 10:53:01 +00:00
zyy17
fdf32a8f46
refactor: respect data_home as root data home directory ( #6050 )
...
* refactor: initialize logging dir by using data_home
* chore: remove tail '/' for dir name
2025-06-09 02:31:21 +00:00
zyy17
14b655ea57
refactor: add SlowQueryRecorder to record slow query in system table and refactor slow query options ( #6008 )
...
* refactor: add common-slow-query crate
* refactor: refine the naming
* chore: fix clippy
* chore: fix typo
* chore: sperate SlowQueryOptions From Logging
* chore: fix clippy
* chore: fix ci
* chore: refine the code
* chore: update config example
* refactor: use drop() to end the slow query timer
* refactor: move common-slow-query to frontend crate
* chore: polish some code
* refactor: code review
* refactor: add promql_range/promql_step/promql_start/promql_end fields in slow_queries
* refactor: add build_slow_query_logger()
* refactor: turn on slow query on frontend by default
2025-05-15 04:18:48 +00:00
Weny Xu
55cadcd2c0
feat: introduce flush metadata region task for metric engine ( #5951 )
...
* feat: introduce flush metadata region task for metric engine
* docs: generate config.md
* chore: add header
* test: fix unit test
* fix: fix unit tests
* chore: apply suggestions from CR
* chore: remove docs
* fix: fix unit tests
2025-04-23 04:51:22 +00:00
Ruihang Xia
c16bae32c4
perf: evolve promql execution engine ( #5691 )
...
* use the same sort option across every prom plan
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* tweak plans
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* wip
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix merge compile
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* Revert "wip"
This reverts commit db58884236waynestxia@gmail.com >
* handle error
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* pass distribution rule
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* reverse sort order
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* refine plans
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* more optimizations for plans
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* check logical table
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix tests
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* wierd tests
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add comment
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add test for series_divide
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update sqlness result
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix scalar calculation
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update sqlness result
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix: workaround join partition
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update proto
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2025-04-08 08:12:15 +00:00
Ning Sun
dc76571166
feat: move default data path from /tmp to current directory ( #5719 )
2025-03-16 09:57:46 +00:00
jeremyhi
29218b5fe7
refactor!: unify the option names across all components part2 ( #5476 )
...
* refactor: part2, replace old options in doc yaml
* chore: remove deprecated options
* chore: update config.md
* fix: ut
2025-02-07 13:06:50 +00:00
jeremyhi
fac22575aa
refactor!: unify the option names across all components ( #5457 )
...
* refactor: rename grpc options
* refactor: make the arg clearly
* chore: comments on server_addr
* chore: fix test
* chore: remove the store_addr alias
* refactor: cli option rpc_server_addr
* chore: keep store-addr alias
* chore: by comment
2025-02-06 06:37:14 +00:00
Ning Sun
698b28c636
feat: provide options to disable or customize http corss-origin settings ( #5450 )
...
* feat: add cors headers for http server
* test: add cors test
* test: add preflight test
* feat: allow customize http cross-origin settings
* chore: typo fix
* test: update tests
* test: fix test for config
* refactor: address review comments
2025-01-26 03:55:34 +00:00
Weny Xu
4323c20d18
feat(metric-engine): introduce experimental_sparse_primary_key_encoding to MetricEngineConfig ( #5373 )
...
* feat: introduce `experimental_sparse_primary_key_encoding` to `MetricEngineConfig`
* fix: unit test
2025-01-20 03:49:39 +00:00
Weny Xu
7f307a4cac
feat: auto detecting local IP to use as hostname ( #5314 )
...
* feat: auto detecting hostname
* chore: update config.md
* chore: bring back hostname
* chore: apply suggestions from CR
* chore: use const
* chore: apply suggesions from CR
* fix: fix sqlness
2025-01-08 12:06:31 +00:00
Kould
1067357b72
chore(config)!: refactor configs of write cache ( #5259 )
...
* chore: refactor configs of write cache
* chore: write_cache_size `10GiB` -> `5GiB`
2025-01-04 07:14:38 +00:00
Yingwen
2fcb95f50a
fix!: fix regression caused by unbalanced partitions and splitting ranges ( #5090 )
...
* feat: assign partition ranges by rows
* feat: balance partition rows
* feat: get uppoer bound for part nums
* feat: only split in non-compaction seq scan
* fix: parallel scan on multiple sources
* fix: can split check
* feat: scanner prepare by request
* feat: remove scan_parallelism
* docs: upate docs
* chore: update comment
* style: fix clippy
* feat: skip merge and dedup if there is only one source
* chore: Revert "feat: skip merge and dedup if there is only one source"
Since memtable won't do dedup jobs
This reverts commit 2fc7a54b11
2024-12-09 12:50:57 +00:00
Lin Yihai
0b6d78a527
refactor: consolidate DatanodeClientOptions ( #4966 )
...
refactor!: consolidate `DatanodeClientOptions`
2024-11-12 09:57:41 +00:00
Weny Xu
5d42e63ab0
fix!: replace timeout_millis and connect_timeout_millis with Duration in DatanodeClientOptions ( #4867 )
...
* fix: correct options struct
* fix: fix unit test
2024-10-23 08:20:34 +00:00
zyy17
0847ff36ce
fix: config test failed and use similar_asserts::assert_eq to replace assert_eq for long string compare ( #4731 )
...
* fix: config test failed and use 'similar_asserts::assert_eq' to replace 'assert_eq' for long string compare
* Update Cargo.toml
Co-authored-by: Yingwen <realevenyag@gmail.com >
* Update src/cmd/tests/load_config_test.rs
Co-authored-by: Yingwen <realevenyag@gmail.com >
---------
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: Yingwen <realevenyag@gmail.com >
2024-09-18 07:41:25 +00:00
zyy17
aa03d3b11c
docs: use docs comment prefix and bump toml2docs version ( #4711 )
2024-09-11 07:49:23 +00:00
Lei, HUANG
208afe402b
feat(wal): increase recovery parallelism ( #4689 )
...
* Refactor RaftEngineLogStore to use references for config
- Updated `RaftEngineLogStore::try_new` to accept a reference to `RaftEngineConfig` instead of taking ownership.
- Replaced direct usage of `config` with individual fields (`sync_write`, `sync_period`, `read_batch_size`).
- Adjusted test cases to pass references to `RaftEngineConfig`.
* Add parallelism configuration for WAL recovery
- Introduced `recovery_parallelism` setting in `datanode.example.toml` and `standalone.example.toml` for configuring parallelism during WAL recovery.
- Updated `Cargo.lock` and `Cargo.toml` to include `num_cpus` dependency.
- Modified `RaftEngineConfig` to include `recovery_parallelism` with a default value set to the number of CP
* feat/wal-recovery-parallelism:
Add `wal.recovery_parallelism` configuration option
- Introduced `wal.recovery_parallelism` to config.md for specifying parallelism during WAL recovery.
- Updated `RaftEngineLogStore` to include `recovery_threads` from the new configuration.
* fix: ut
2024-09-09 04:25:24 +00:00
Weny Xu
79f40a762b
fix: set selector_result_cache_size in unit test again ( #4641 )
2024-08-29 07:14:40 +00:00
Weny Xu
744946957e
fix: set selector_result_cache_size in unit test ( #4631 )
2024-08-28 07:24:17 +00:00
Yingwen
a12a905578
chore: disable ttl for write cache by default ( #4595 )
...
* chore: remove default write cache ttl
* docs: update example config
* chore: fix ci
2024-08-21 08:38:38 +00:00
Ning Sun
9532ffb954
fix: configuration example for selector ( #4532 )
...
* fix: configuration example for selector
* docs: update config docs
* test: update unit tests for configuration in meta
2024-08-09 09:51:05 +00:00
Weny Xu
a25d9f736f
chore: set default otlp_endpoint ( #4508 )
...
* chore: set default `otlp_endpoint`
* fix: fix ci
2024-08-06 06:48:14 +00:00
Ruihang Xia
7daf24c47f
feat: remove dedicated runtime for grpc, mysql and pg protocols ( #4436 )
...
* feat: remove dedicated runtime for grpc, mysql and pg protocols
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* remove other runtimes
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* spawn compact task into compact_runtime
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* refine naming
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* Update src/servers/tests/mysql/mysql_server_test.rs
Co-authored-by: Zhenchi <zhongzc_arch@outlook.com >
* fix clippy
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* turnoff fuzz test matrix fail fast option
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* chore: update rt config for ci tests
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: Zhenchi <zhongzc_arch@outlook.com >
Co-authored-by: Weny Xu <wenymedia@gmail.com >
2024-07-30 06:17:58 +00:00
irenjj
9f2d53c3df
refactor: Remove the StandaloneKafkaConfig struct ( #4253 )
...
* refactor: Remove the StandaloneKafkaConfig struct
* remove the redundant assignment
* remove rudundant struct
* simplify replication_factor
* add KafkaTopicConfig
* fix check
* fix check
* fix check
* add flatten with
* revert config.md
* fix test params
* fix test param
* fix missing params when provider is kafka
* remove unsed files
* remove with prefix
* fix doc
* fix test
* fix clippy
2024-07-12 08:17:18 +00:00
Weny Xu
7ad248d6f6
fix(config): enable file engine by default ( #4345 )
...
* fix: enable file engine by default
* fix: fix tests
2024-07-11 17:35:18 +00:00
taobo
22d12683b4
refactor!: unify FrontendOptions and DatanodeOptions by using GrpcOptions ( #4088 )
...
* refactor: move GrpcOptions to servers/grpc
* fix: optimize code
* fix: docs
* refactor: move DatanodeOptions.rpc_hostname to grpc.hostname
* fix: merge main
* refactor code impl
test: add test_depreacted_cli_options unit test
* Update src/servers/src/grpc.rs
Co-authored-by: Yingwen <realevenyag@gmail.com >
---------
Co-authored-by: Yingwen <realevenyag@gmail.com >
2024-06-18 22:45:38 +00:00
Ning Sun
70d113a355
feat: update default size of bgworkers, add hbworkers ( #4129 )
...
* feat: update default size of bgworkers, add hbworkers
* feat: update frontend heartbeat as well
* chore: update sample config files and default settings
* chore: update config docs
* Revert "chore: update config docs"
This reverts commit 8107f4c120f5ae701c8d
2024-06-18 06:18:37 +00:00
LFC
9473daab8b
fix: explicitly set config instead of using changable default in tests ( #4132 )
...
* fix: explicitly set config instead of using changable default in tests
* fix: resolve PR comments
2024-06-11 10:51:01 +00:00
LFC
c0aed1d267
feat: set global runtime size by config file ( #4063 )
...
* set global runtime size
* fix: resolve PR comments
* fix: log the whole option
* fix ci
* debug ci
* debug ci
---------
Co-authored-by: Weny Xu <wenymedia@gmail.com >
2024-06-04 10:03:33 +00:00
