zyy17
aa03d3b11c
docs: use docs comment prefix and bump toml2docs version ( #4711 )
2024-09-11 07:49:23 +00:00
Lei, HUANG
208afe402b
feat(wal): increase recovery parallelism ( #4689 )
...
* Refactor RaftEngineLogStore to use references for config
- Updated `RaftEngineLogStore::try_new` to accept a reference to `RaftEngineConfig` instead of taking ownership.
- Replaced direct usage of `config` with individual fields (`sync_write`, `sync_period`, `read_batch_size`).
- Adjusted test cases to pass references to `RaftEngineConfig`.
* Add parallelism configuration for WAL recovery
- Introduced `recovery_parallelism` setting in `datanode.example.toml` and `standalone.example.toml` for configuring parallelism during WAL recovery.
- Updated `Cargo.lock` and `Cargo.toml` to include `num_cpus` dependency.
- Modified `RaftEngineConfig` to include `recovery_parallelism` with a default value set to the number of CP
* feat/wal-recovery-parallelism:
Add `wal.recovery_parallelism` configuration option
- Introduced `wal.recovery_parallelism` to config.md for specifying parallelism during WAL recovery.
- Updated `RaftEngineLogStore` to include `recovery_threads` from the new configuration.
* fix: ut
2024-09-09 04:25:24 +00:00
Weny Xu
79f40a762b
fix: set selector_result_cache_size in unit test again ( #4641 )
2024-08-29 07:14:40 +00:00
Weny Xu
744946957e
fix: set selector_result_cache_size in unit test ( #4631 )
2024-08-28 07:24:17 +00:00
Yingwen
a12a905578
chore: disable ttl for write cache by default ( #4595 )
...
* chore: remove default write cache ttl
* docs: update example config
* chore: fix ci
2024-08-21 08:38:38 +00:00
Ning Sun
9532ffb954
fix: configuration example for selector ( #4532 )
...
* fix: configuration example for selector
* docs: update config docs
* test: update unit tests for configuration in meta
2024-08-09 09:51:05 +00:00
Weny Xu
a25d9f736f
chore: set default otlp_endpoint ( #4508 )
...
* chore: set default `otlp_endpoint`
* fix: fix ci
2024-08-06 06:48:14 +00:00
Ruihang Xia
7daf24c47f
feat: remove dedicated runtime for grpc, mysql and pg protocols ( #4436 )
...
* feat: remove dedicated runtime for grpc, mysql and pg protocols
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* remove other runtimes
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* spawn compact task into compact_runtime
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* refine naming
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* Update src/servers/tests/mysql/mysql_server_test.rs
Co-authored-by: Zhenchi <zhongzc_arch@outlook.com >
* fix clippy
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* turnoff fuzz test matrix fail fast option
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* chore: update rt config for ci tests
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: Zhenchi <zhongzc_arch@outlook.com >
Co-authored-by: Weny Xu <wenymedia@gmail.com >
2024-07-30 06:17:58 +00:00
irenjj
9f2d53c3df
refactor: Remove the StandaloneKafkaConfig struct ( #4253 )
...
* refactor: Remove the StandaloneKafkaConfig struct
* remove the redundant assignment
* remove rudundant struct
* simplify replication_factor
* add KafkaTopicConfig
* fix check
* fix check
* fix check
* add flatten with
* revert config.md
* fix test params
* fix test param
* fix missing params when provider is kafka
* remove unsed files
* remove with prefix
* fix doc
* fix test
* fix clippy
2024-07-12 08:17:18 +00:00
Weny Xu
7ad248d6f6
fix(config): enable file engine by default ( #4345 )
...
* fix: enable file engine by default
* fix: fix tests
2024-07-11 17:35:18 +00:00
taobo
22d12683b4
refactor!: unify FrontendOptions and DatanodeOptions by using GrpcOptions ( #4088 )
...
* refactor: move GrpcOptions to servers/grpc
* fix: optimize code
* fix: docs
* refactor: move DatanodeOptions.rpc_hostname to grpc.hostname
* fix: merge main
* refactor code impl
test: add test_depreacted_cli_options unit test
* Update src/servers/src/grpc.rs
Co-authored-by: Yingwen <realevenyag@gmail.com >
---------
Co-authored-by: Yingwen <realevenyag@gmail.com >
2024-06-18 22:45:38 +00:00
Ning Sun
70d113a355
feat: update default size of bgworkers, add hbworkers ( #4129 )
...
* feat: update default size of bgworkers, add hbworkers
* feat: update frontend heartbeat as well
* chore: update sample config files and default settings
* chore: update config docs
* Revert "chore: update config docs"
This reverts commit 8107f4c120f5ae701c8d
2024-06-18 06:18:37 +00:00
LFC
9473daab8b
fix: explicitly set config instead of using changable default in tests ( #4132 )
...
* fix: explicitly set config instead of using changable default in tests
* fix: resolve PR comments
2024-06-11 10:51:01 +00:00
LFC
c0aed1d267
feat: set global runtime size by config file ( #4063 )
...
* set global runtime size
* fix: resolve PR comments
* fix: log the whole option
* fix ci
* debug ci
* debug ci
---------
Co-authored-by: Weny Xu <wenymedia@gmail.com >
2024-06-04 10:03:33 +00:00
Lei, HUANG
f287d3115b
chore: replace result assertions ( #1840 )
...
* s/assert!\((.*)\.is_ok\(\)\);/\1.unwrap\(\);/g
* s/assert!\((.*)\.is_some\(\)\);/\1.unwrap\(\);/g
2023-06-27 19:14:48 +08:00
LFC
fcff66e039
chore: deny unused results ( #1825 )
...
* chore: deny unused results
* rebase
2023-06-27 15:33:53 +08:00
dennis zhuang
7c55783e53
feat!: reorganize the storage layout ( #1609 )
...
* feat: adds data_home to DataOptions
* refactor: split out object store stuffs from datanode instance
* feat: move data_home into FileConfig
* refactor: object storage layers
* feat: adds datanode path to procedure paths
* feat: temp commit
* refactor: clean code
* fix: forgot files
* fix: forgot files
* Update src/common/test-util/src/ports.rs
Co-authored-by: Yingwen <realevenyag@gmail.com >
* Update tests/runner/src/env.rs
Co-authored-by: Yingwen <realevenyag@gmail.com >
* fix: compile error
* chore: cr comments
* fix: dependencies order in cargo
* fix: data path in test
---------
Co-authored-by: Yingwen <realevenyag@gmail.com >
2023-05-23 13:58:26 +08:00
LFC
604c20a83d
refactor: remove the SQL execution interfaces in Datanode ( #1135 )
...
* refactor: remove the SQL execution interfaces in Datanode
2023-03-13 18:45:30 +08:00
Eugene Tolbakov
b31a6cb506
refactor: replace tempdir with tempfile ( #1123 )
...
* refactor: replace tempdir with tempfile
* refactor(query): move tempfile dependency under the workspace's Cargo.toml
* refactor(tempfile): create common-test-util
* refactor(tempfile): fix toml format
* refactor(tempfile): remove tempfile out of dependencies
* refactor(tempfile): fix incorrect toml
2023-03-08 11:15:56 +08:00
LFC
df751c38b4
feat: a simple REPL for debugging purpose ( #1048 )
...
* feat: a simple REPL for debugging purpose
* fix: rebase develop
2023-02-27 11:00:15 +08:00
