JohnsonLee
a8477e4142
fix: table resolving logic related to pg_catalog ( #4580 )
...
* fix: table resolving logic related to pg_catalog
refer to
https://github.com/GreptimeTeam/greptimedb/issues/3560#issuecomment-2287794348
and #4543
* refactor: remove CatalogProtocol type
* fix: sqlness
* fix: forbid create database pg_catalog with mysql client
* refactor: use QueryContext as arguments rather than Channel
* refactor: pass None as default behaviour in information_schema
* test: fix test
2024-09-09 00:47:59 +00:00
dennis zhuang
63f2463273
feat!: impl admin command ( #4600 )
...
* feat: impl admin statement parser
* feat: introduce AsyncFunction and implements it for admin functions
* feat: execute admin functions
* fix: license header
* fix: panic in test
* chore: fixed by code review
2024-08-26 07:53:40 +00:00
Weny Xu
2e2eacf3b2
feat: add SASL and TLS config for Kafka client ( #4536 )
...
* feat: add SASL and TLS config
* feat: add SASL/PLAIN and TLS config for Kafka client
* chore: use `ring`
* feat: support SASL SCRAM-SHA-256 and SCRAM-SHA-512
* fix: correct unit test
* test: add integration test
* chore: apply suggestions from CR
* refactor: introduce `KafkaConnectionConfig`
* chore: refine toml examples
* docs: add missing fields
* chore: refine examples
* feat: allow no server ca cert
* chore: refine examples
* chore: fix clippy
* feat: load system ca certs
* chore: fmt toml
* chore: unpin version
* Update src/common/wal/src/error.rs
Co-authored-by: Lei, HUANG <6406592+v0y4g3r@users.noreply.github.com >
---------
Co-authored-by: Lei, HUANG <6406592+v0y4g3r@users.noreply.github.com >
2024-08-12 12:27:11 +00:00
irenjj
9f2d53c3df
refactor: Remove the StandaloneKafkaConfig struct ( #4253 )
...
* refactor: Remove the StandaloneKafkaConfig struct
* remove the redundant assignment
* remove rudundant struct
* simplify replication_factor
* add KafkaTopicConfig
* fix check
* fix check
* fix check
* add flatten with
* revert config.md
* fix test params
* fix test param
* fix missing params when provider is kafka
* remove unsed files
* remove with prefix
* fix doc
* fix test
* fix clippy
2024-07-12 08:17:18 +00:00
Weny Xu
15ad9f2f6f
fix: region logical regions after catching up ( #4176 )
...
* fix: region logical regions after catching up
* test: add metric table migration test
* chore: apply suggestions from CR
2024-06-21 10:30:18 +00:00
Weny Xu
ea2d067cf1
feat: implement the OrderedBatchProducer ( #4134 )
...
* feat: implement the `OrderedBatchProducer`
* test: add test of cancel safety
* chore: apply suggestions from CR
* chore: apply suggestions from CR
* refactor: simplify the `BackgroundProducerWorker`
* feat: implement the OrderedBatchProducer v2
* refactor: switch to `OrderedBatchProducer`
* chore: rename to `MAX_FLUSH_QUEUE_SIZE`
* refactor: switch to `OrderedBatchProducerV2`
* refactor: remove `OrderedBatchProducerV1`
* test: add tests
* refactor: make config configurable
* refactor: minor refactor
* chore: remove unused code
* chore: remove `benchmarks` crate
* chore: update config doc
* chore: remove unused comment
* refactor: refactor client registry
* refactor: rename `max_batch_size` to `max_batch_bytes`
* chore: use constant value
* chore: ensure serialized meta < ESTIMATED_META_SIZE
* chore: apply suggestions from CR
* chore: remove the `CHANNEL_SIZE`
* chore: apply suggestions from CR
* fix: ensure serialized meta < ESTIMATED_META_SIZE
* chore: apply suggestions from CR
* chore: apply suggestions from CR
2024-06-18 07:20:01 +00:00
dennis zhuang
65d47bab56
feat: adds information_schema cluster_info table ( #3832 )
...
* feat: adds server running mode to KvBackendCatalogManager
* feat: adds MetaClient to KvBackendCatalogManager
* feat: impl information_schema.cluster_info table
* fix: forgot files
* test: update information_schema result
* feat: adds start_time and uptime to cluster_info
* chore: tweak cargo and comment
* feat: rename greptime_region_peers to region_peers
* fix: cluster_info result
* chore: simplify sqlness commands
* chore: set peer_id to -1 for frontends
* fix: move cluster_info to greptime catalog
* chore: use official proto
* feat: adds active_time
* chore: apply suggestion
Co-authored-by: Jeremyhi <jiachun_feng@proton.me >
* chore: STANDALONE for runtime_metrics
---------
Co-authored-by: Jeremyhi <jiachun_feng@proton.me >
Co-authored-by: tison <wander4096@gmail.com >
2024-05-02 02:49:46 +00:00
JeremyHi
1629435888
chore: unify name metasrv ( #3671 )
...
chore: unify name
2024-04-09 03:03:26 +00:00
niebayes
d5ba2fcf9d
test: add more integration test for kafka wal ( #3190 )
...
* test: add integration tests for kafka wal
* chore: rebase main
* chore: unify naming convention for wal config
* chore: add register loaders switch
* chore: alter tables by adding a new column
* chore: move rand to dev-dependencies
* chore: update Cargo.lock
2024-03-28 06:55:18 +00:00
shuiyisong
0bb949787c
refactor: introduce new Output with OutputMeta ( #3466 )
...
* refactor: introduce new output struct
* chore: add helper function
* chore: update comment
* chore: update commit
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
* chore: rename according to cr
---------
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
2024-03-11 02:24:09 +00:00
dennis zhuang
4b36c285f1
feat: flush or compact table and region functions ( #3363 )
...
* feat: adds Requester to process table flush and compaction request
* feat: admin_fn macros for administration functions
* test: add query result
* feat: impl flush_region, flush_table, compact_region, and flush_region functions
* docs: add Arguments to admin_fn macro
* chore: apply suggestion
Co-authored-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: apply suggestion
Co-authored-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: group_requests_by_peer and adds log
* Update src/common/macro/src/admin_fn.rs
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
* feat: adds todo for spawan thread
* feat: rebase with main
---------
Co-authored-by: Zhenchi <zhongzc_arch@outlook.com >
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
2024-02-27 08:57:38 +00:00
Ruihang Xia
3544c9334c
feat!: new partition grammar - parser part ( #3347 )
...
* parser part
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix test in sql
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* comment out and ignore some logic
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update sqlness cases
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update region migration test
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* temporary disable region migration test
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* allow dead code
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update integration test
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2024-02-27 07:20:16 +00:00
dennis zhuang
564fe3beca
feat: impl migrate_region and procedure_state SQL function ( #3325 )
...
* fix: logical region can't find region routes
* feat: fetch partitions info in batch
* refactor: rename batch functions
* refactor: rename DdlTaskExecutor to ProcedureExecutor
* feat: impl migrate_region and query_procedure_state for ProcedureExecutor
* feat: adds SQL function procedure_state and finish migrate_region impl
* fix: constant vector
* feat: unit tests for migrate_region and procedure_state
* test: test region migration by SQL
* fix: compile error after rebeasing
* fix: clippy warnings
* feat: ensure procedure_state and migrate_region can be only called under greptime catalog
* fix: license header
2024-02-22 02:37:11 +00:00
niebayes
63205907fb
refactor: introduce common-wal to aggregate wal stuff ( #3171 )
...
* refactor: aggregate wal configs
* refactor: move wal options to common-wal
* chore: slim Cargo.toml
* fix: add missing crates
* fix: format
* chore: update comments
* chore: add testing feature gate for test_util
* fix: apply suggestions from code review
Co-authored-by: JeremyHi <jiachun_feng@proton.me >
* fix: apply suggestions from code review
* fix: compiling
---------
Co-authored-by: JeremyHi <jiachun_feng@proton.me >
2024-01-18 03:49:37 +00:00
LFC
51a3fbc7bf
refactor: change how frontend grpc services are orchestrated ( #3134 )
2024-01-11 02:26:44 +00:00
Weny Xu
3ab370265a
feat: expose the region migration replay_timeout argument ( #3129 )
...
* feat: expose region migration args
* fix: fix ci
2024-01-10 09:47:59 +00:00
Weny Xu
f1a4750576
feat(tests-integration): add more region migration integration tests ( #3094 )
2024-01-04 08:18:46 +00:00
Weny Xu
611a8aa2fe
feat(tests-integration): add a naive region migration integration test ( #3078 )
...
* fix: fix heartbeat handler ignore upgrade candidate instruction
* fix: fix handler did not inject wal options
* feat: expose `RegionMigrationProcedureTask`
* feat(tests-integration): add a naive region migration test
* chore: apply suggestions from CR
* feat: add test if the target region has migrated
* chore: apply suggestions from CR
2024-01-03 07:12:59 +00:00