Weny Xu
5545a8b023
feat: implement drop flow procedure ( #3877 )
...
* feat: implement `destroy_flow_metadata` method
* chore: bump proto to 65c1364
* feat: implement the drop flow procedure
* feat: add `MockFlownodeManager`
* tests: add tests for create flow & drop flow procedure
* chore: apply suggestions from CR
* chore: use `ClusterId`
2024-05-09 08:23:19 +00:00
Jeremyhi
7de62ef5d0
feat: add metasrv start time to node info ( #3883 )
2024-05-09 06:53:55 +00:00
Jeremyhi
6e1cc1df55
feat: metasrvs nodeinfo ( #3873 )
...
* feat: get metasrv nodeinfo
* fix: sqlness test
* chore: by comment
* feat: proto version
2024-05-07 11:20:57 +00:00
dennis zhuang
65d47bab56
feat: adds information_schema cluster_info table ( #3832 )
...
* feat: adds server running mode to KvBackendCatalogManager
* feat: adds MetaClient to KvBackendCatalogManager
* feat: impl information_schema.cluster_info table
* fix: forgot files
* test: update information_schema result
* feat: adds start_time and uptime to cluster_info
* chore: tweak cargo and comment
* feat: rename greptime_region_peers to region_peers
* fix: cluster_info result
* chore: simplify sqlness commands
* chore: set peer_id to -1 for frontends
* fix: move cluster_info to greptime catalog
* chore: use official proto
* feat: adds active_time
* chore: apply suggestion
Co-authored-by: Jeremyhi <jiachun_feng@proton.me >
* chore: STANDALONE for runtime_metrics
---------
Co-authored-by: Jeremyhi <jiachun_feng@proton.me >
Co-authored-by: tison <wander4096@gmail.com >
2024-05-02 02:49:46 +00:00
Ruihang Xia
0c5f4801b7
build: update toolchain to nightly-2024-04-18 ( #3740 )
...
* chore: update toolchain to nightly-2024-04-17
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix test clippy
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix ut
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update fuzz test
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update to nightly-2024-04-18
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add document
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update CI
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* avoid unnecessary allow clippy attrs
Signed-off-by: tison <wander4096@gmail.com >
* help the compiler find the clone is unnecessary and make clippy happy
Signed-off-by: tison <wander4096@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Signed-off-by: tison <wander4096@gmail.com >
Co-authored-by: tison <wander4096@gmail.com >
2024-04-19 05:42:34 +00:00
Jeremyhi
e6507aaf34
chore: debt 3696 ( #3705 )
2024-04-15 09:02:19 +00:00
Jeremyhi
87795248dd
feat: get metasrv clusterinfo ( #3696 )
...
* feat: add doc for MetasrvOptions
* feat: register candidate before election
* feat: get all peers metasrv
* chore: simply code
* chore: proto rev
* Update src/common/meta/src/cluster.rs
Co-authored-by: dennis zhuang <killme2008@gmail.com >
* Update src/meta-client/src/client.rs
Co-authored-by: dennis zhuang <killme2008@gmail.com >
* fmt
Signed-off-by: tison <wander4096@gmail.com >
* Apply suggestions from code review
Co-authored-by: dennis zhuang <killme2008@gmail.com >
* impl<T: AsRef<[u8]>> From<T> for LeaderValue
Signed-off-by: tison <wander4096@gmail.com >
---------
Signed-off-by: tison <wander4096@gmail.com >
Co-authored-by: dennis zhuang <killme2008@gmail.com >
Co-authored-by: tison <wander4096@gmail.com >
2024-04-15 08:10:48 +00:00
JeremyHi
12286f07ac
feat: cluster information ( #3631 )
...
* chore: keep the same method order in KvBackend
* feat: make meta client can get all node info of cluster
* feat: cluster info data model
* feat: frontend and datanode info
* feat: list node info
* chore: remove the method: is_started
* fix: scan key prefix
* chore: impl From for NodeInfoKey
* chore: doc for trait and struct
* chore: reuse the error
* chore: refactor two collec cluster info handlers
* chore: remove inline
* chore: refactor two collec cluster info handlers
2024-04-08 07:48:36 +00:00
dimbtp
dd18d8c97b
build(deps): remove some unused dependencies ( #3582 )
...
* build(deps): remove some unused dependencies
* add `arc-swap` dependency back
2024-03-26 12:48:28 +00:00
dennis zhuang
564fe3beca
feat: impl migrate_region and procedure_state SQL function ( #3325 )
...
* fix: logical region can't find region routes
* feat: fetch partitions info in batch
* refactor: rename batch functions
* refactor: rename DdlTaskExecutor to ProcedureExecutor
* feat: impl migrate_region and query_procedure_state for ProcedureExecutor
* feat: adds SQL function procedure_state and finish migrate_region impl
* fix: constant vector
* feat: unit tests for migrate_region and procedure_state
* test: test region migration by SQL
* fix: compile error after rebeasing
* fix: clippy warnings
* feat: ensure procedure_state and migrate_region can be only called under greptime catalog
* fix: license header
2024-02-22 02:37:11 +00:00
SteveLauC
e9a2b0a9ee
chore: use workspace-wide lints ( #3352 )
...
* chore: use workspace-wide lints
* respond to review
2024-02-22 01:01:10 +00:00
tison
4e04a4e48f
build: support build without git ( #3309 )
...
* build: support build without git
Signed-off-by: tison <wander4096@gmail.com >
* chore
Signed-off-by: tison <wander4096@gmail.com >
* address comment
Signed-off-by: tison <wander4096@gmail.com >
* fix syntax
Signed-off-by: tison <wander4096@gmail.com >
---------
Signed-off-by: tison <wander4096@gmail.com >
2024-02-18 10:30:01 +00:00
dennis zhuang
e5ec65988b
feat: administration functions ( #3236 )
...
* feat: adds database() function to return current db
* refactor: refactor meta src and client with new protos
* feat: impl migrate_region and query_procedure_state for procedure service/client
* fix: format
* temp commit
* feat: impl migrate_region SQL function
* chore: clean code for review
* fix: license header
* fix: toml format
* chore: update proto dependency
* chore: apply suggestion
Co-authored-by: Weny Xu <wenymedia@gmail.com >
* chore: apply suggestion
Co-authored-by: Weny Xu <wenymedia@gmail.com >
* chore: apply suggestion
Co-authored-by: JeremyHi <jiachun_feng@proton.me >
* chore: apply suggestion
Co-authored-by: fys <40801205+fengys1996@users.noreply.github.com >
* chore: print key when parsing procedure id fails
* chore: comment
* chore: comment for MigrateRegionFunction
---------
Co-authored-by: Weny Xu <wenymedia@gmail.com >
Co-authored-by: JeremyHi <jiachun_feng@proton.me >
Co-authored-by: fys <40801205+fengys1996@users.noreply.github.com >
2024-02-07 01:12:32 +00:00
fys
74bfb09195
feat: support cache for batch_get in CachedMetaKvBackend ( #3277 )
...
* feat: support cache for batch_get in CachedMetaKvBackend.
* add doc of CachedMetaKvBackend
* fix: cr
* fix: correct some words
* fix cr
2024-02-06 03:15:03 +00:00
tison
316d843482
feat: support CSV format in sql HTTP API ( #3062 )
...
* chore: fix typo
Signed-off-by: tison <wander4096@gmail.com >
* add csv format
Signed-off-by: tison <wander4096@gmail.com >
* flatten response
Signed-off-by: tison <wander4096@gmail.com >
* more flatten response
Signed-off-by: tison <wander4096@gmail.com >
* add CSV format
Signed-off-by: tison <wander4096@gmail.com >
* format InfluxdbV1Response
Signed-off-by: tison <wander4096@gmail.com >
* format ErrorResponse
Signed-off-by: tison <wander4096@gmail.com >
* propagate ErrorResponse to InfluxdbV1Response
Signed-off-by: tison <wander4096@gmail.com >
* format GreptimedbV1Response
Signed-off-by: tison <wander4096@gmail.com >
* format CsvResponse
Signed-off-by: tison <wander4096@gmail.com >
* impl IntoResponse for QueryResponse
Signed-off-by: tison <wander4096@gmail.com >
* promql
Signed-off-by: tison <wander4096@gmail.com >
* sql
Signed-off-by: tison <wander4096@gmail.com >
* compile
Signed-off-by: tison <wander4096@gmail.com >
* fixup aide
Signed-off-by: tison <wander4096@gmail.com >
* clear debt
Signed-off-by: tison <wander4096@gmail.com >
* fixup UT test_recordbatches_conversion
Signed-off-by: tison <wander4096@gmail.com >
* fixup IT cases
Signed-off-by: tison <wander4096@gmail.com >
* fixup more IT cases
Signed-off-by: tison <wander4096@gmail.com >
* fixup test-integration cases
Signed-off-by: tison <wander4096@gmail.com >
* update comment
Signed-off-by: tison <wander4096@gmail.com >
* fixup deserialize and most query < 1ms
Signed-off-by: tison <wander4096@gmail.com >
* fixup auth tests
Signed-off-by: tison <wander4096@gmail.com >
* fixup tests
Signed-off-by: tison <wander4096@gmail.com >
* fixup and align X-GreptimeDB headers
Signed-off-by: tison <wander4096@gmail.com >
* fixup compile
Signed-off-by: tison <wander4096@gmail.com >
---------
Signed-off-by: tison <wander4096@gmail.com >
2024-01-08 10:54:27 +00:00
Yingwen
6a57f4975e
perf(mito): scan SSTs and memtables in parallel ( #2852 )
...
* feat: seq scan support parallelism
* feat: scan region by parallelism in config
* feat: enlarge channel size
* chore: parallel builder logs
* feat: use parallel reader accroding to source num
* chore: 128 channel size
* feat: add fetch cost metrics
* feat: add channel size to config
* feat: builder cost
* feat: logs
* feat: compiler error
* feat: fetch cost
* feat: convert cost
* chore: Revert "feat: logs"
This reverts commit 01e0df2c3a
2023-12-11 06:43:17 +00:00
fys
da68d8ce4b
feat: add random weighted choose in load_based selector ( #2234 )
...
* feat: add random weigted choose in load_based selector
* fix: meta cannot save heartbeats when cluster have no region
* chore: print some log
* chore: remove unused code
* cr
* add some logs when filter result is empty
2023-11-20 06:47:42 +00:00
WU Jingdi
500e299e40
feat: Enable distributed tracing in greptimedb ( #2755 )
...
* feat: implement distributed tracing
* fix: change usage of span
* fix: use otlp as exporter
* chore: update dependence
* chore: add span info
* chore: add alias
* chore: use instrument instead of trace
2023-11-17 08:51:57 +00:00
tison
0cd6dacb45
chore: multiple licenses fixes ( #2714 )
...
* chore: avoid license risk from akka
Signed-off-by: tison <wander4096@gmail.com >
* chore: LICENSE test is AS IS
Signed-off-by: tison <wander4096@gmail.com >
* ci: use hawkeye to pin in inceptionYear
Signed-off-by: tison <wander4096@gmail.com >
* add instruction for running license header apply
Signed-off-by: tison <wander4096@gmail.com >
---------
Signed-off-by: tison <wander4096@gmail.com >
2023-11-09 10:38:12 +00:00
Ruihang Xia
93f21b188d
chore: unify workspace dependencies and remove some unused ( #2713 )
...
* log-store
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* base64
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* udeps
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* snafu
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* snafu style
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* change the workspace deps' style
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-11-09 07:34:22 +00:00
Weny Xu
88eb69530a
refactor: remove router rpc ( #2646 )
2023-10-31 04:54:56 +00:00
Weny Xu
bd177b8cc4
refactor: remove move_value ( #2661 )
...
* chore: bump orc-rust to 0.2.42
* refactor: remove move_value
2023-10-27 03:42:50 +00:00
Yun Chen
f859932745
fix: convert to ReadableSize & Durations ( #2594 )
...
* fix: convert to ReadableSize & Durations
* fix: change more grpc sender/recv message size to ReadableSize
fix: format
fix: cargo fmt
fix: change cmd test to use durations
fix: revert metaclient change
fix: convert default fields in meta client options
fix: human serde meta client durations
* fix: remove milisecond postfix in heartbeat option
* fix: humantime serde on heartbeat
* fix: update config example
* fix: update integration test config
* fix: address pr comments
* fix: fix pr comment on default annotation
2023-10-13 03:28:29 +00:00
Zhenchi
201acd152d
fix: missing file engine with default options ( #2519 )
...
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
2023-09-28 10:25:12 +00:00
Weny Xu
9282e59a3b
fix: re-create heartbeat stream ASAP ( #2499 )
...
* chore: set default connect_timeout_millis to 1000
* fix: re-create heartbeat stream ASAP
* chore: apply suggestions
2023-09-27 04:00:16 +00:00
Ruihang Xia
515ce825bd
feat: stack trace style debug print for error ( #2489 )
...
* impl macro stack_trace_debug
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* manually mark external error
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* ignore warnings
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix clippy warnings
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* use debug print
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* simplify the error and warn macro
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix ut
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add docs
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* replace snafu backtrace with location
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-09-26 11:23:21 +00:00
Weny Xu
230a3026ad
fix: dn doesn't have chance to send a heartbeat to the new leader ( #2471 )
...
* refactor: set meta leader lease secs to 3s
* fix: correct default heartbeat interval
* refactor: ask meta leader in parallel
* feat: configure heartbeat client timeout to 500ms
* fix: trigger to send heartbeat immediately after fail
* fix: fix clippy
2023-09-26 05:05:38 +00:00
shuiyisong
20f4f7971a
refactor: remove source and location in snafu display ( #2428 )
...
* refactor: remove source pt 1
* refactor: remove source pt 2
* refactor: remove source pt 3
* refactor: remove location pt 1
* refactor: remove location pt 2
* chore: remove rustc files
* chore: fix error case
* chore: fix test
* chore: fix test
* chore: fix cr issue
Co-authored-by: fys <40801205+fengys1996@users.noreply.github.com >
---------
Co-authored-by: fys <40801205+fengys1996@users.noreply.github.com >
2023-09-21 02:55:24 +00:00
Weny Xu
f386329e29
refactor: introduce DdlTaskExecutor and refactor statement executor ( #2341 )
...
* feat: add kv store option
* refactor: refactor statement executor
* refactor: refactor standalone table creator
* chore: apply suggestions from CR
* chore: apply suggestions from CR
* refactor: move ShowCreateTable and CreateDatabase to StatementExecutor
* fix: fix RegionDistribution
* feat: build standalone
* chore: apply suggestions from CR
* chore: apply suggestions from CR
* chore: apply suggestions from CR
2023-09-12 07:57:15 -05:00
Weny Xu
e4de63625f
refactor: refactor raft engine backend and state store ( #2336 )
...
* refactor: remove redundant code
* refactor: refactor RaftEngineBackend Error to common_meta::error::Error
* refactor: refactor state store
* chore: apply suggestions from CR
2023-09-12 07:57:15 -05:00
Weny Xu
922e342b63
refactor: refactor ddl manager ( #2306 )
...
* refactor: refactor ddl manager
* chore: apply suggestions from CR
2023-09-12 07:57:15 -05:00
Weny Xu
4818887e38
refactor: refactor DistInstance ( #2305 )
2023-09-12 07:57:15 -05:00
Weny Xu
5b7b2cf77d
fix: fix ddl client can not update leader addr ( #2205 )
...
* fix: fix ddl client can not update leader addr
* chore: apply suggestions from CR
* feat: add message to context
* fix: only retry if unavailable or deadline exceeded
* chore: apply suggestions from CR
2023-08-21 13:57:29 +00:00
dennis zhuang
272f649b22
fix: some TODO in sqlness cases and refactor meta-client error ( #2207 )
...
* fix: some TODO in sqlness cases and refactor meta-client error
* fix: delete tests/cases/standalone/alter/drop_col_not_null_next.output
2023-08-18 10:09:11 +00:00
Ning Sun
c39de9072f
refactor: use workspace dependencies for internal modules ( #2119 )
...
* refactor: use workspace dependencies for internal modules
* fix: resolve issue with mock module in datanode
* refactor: update test modules
2023-08-08 11:02:34 +00:00
Weny Xu
7d0d8dc6e3
feat: return metasrv leader addr ( #2110 )
2023-08-07 10:01:42 +00:00
shuiyisong
7efff2d704
fix: introduce taplo.toml and sort Cargo.toml ( #2096 )
...
* fix: add taplo.toml
* fix: introduce taplo.toml & sort cargo.toml
* chore: remove option in ci too
2023-08-04 06:44:45 +00:00
LFC
7cf6c2bd5c
refactor: trying to replace TableGlobalValue, part 1 ( #1956 )
...
* refactor: trying to replace TableGlobalValue, part 1
* fix: resolve PR comments
2023-07-17 11:32:46 +08:00
JeremyHi
c9cce0225d
feat: ask leader ( #1957 )
...
* feat: ask leader
* fix: license header
* chore: by comment
2023-07-14 11:32:47 +08:00
Weny Xu
735c6390ca
feat: implement alter table procedure ( #1878 )
...
* feat: implement alter table procedure
* fix: fix uncaught error
* refactor: move fetch_table/s to table_routes.rs
* refactor: refactor error handling
* chore: apply suggestions from CR
* feat: switch to using alter table procedure
* feat: add table_version
* chore: apply suggestions from CR
* feat: introduce ddl_channel_manager
* chore: update greptime-proto
2023-07-13 10:41:46 +08:00
Ben Baoyi
9ff7670adf
refactor:remove common_error::prelude ( #1946 )
...
* feat:Remove common_error::prelude
* fix merge error
* cr comment
* fix error
2023-07-13 10:36:36 +08:00
LFC
4fdb6d2f21
refactor: remote catalog uses memory ( #1926 )
...
* refactor: remote catalog uses memory
* rebase develop
* fix: resolve PR comments
2023-07-12 09:33:33 +00:00
Weny Xu
a751aa5ba0
feat: switch to using drop table procedure ( #1901 )
...
* feat: switch to using drop table procedure
* chore: remove unused attributes
* feat: register the drop table procedure loader
* fix: fix typo
2023-07-12 10:35:23 +08:00
Weny Xu
b31fad5d52
feat: switch to using create table procedure ( #1861 )
...
* feat: switch to using create table procedure
* fix: add missing table_id and fix uncaught error
* refactor: remove unused code and metrics
* chore: apply suggestions from CR
* chore: remove unused attributes
* feat: add info log and metrics
* fix: fix conflicts
2023-07-10 10:08:09 +08:00
LFC
f19498f73e
refactor: unify KvBackend and KvStore ( #1890 )
...
* refactor: unify KvBackend and KvStore
2023-07-07 19:53:49 +08:00
Weny Xu
000df8cf1e
feat: add ddl client ( #1856 )
...
* feat: add ddl client
* chore: apply suggestions from CR
* chore: apply suggestions from CR
2023-07-04 19:32:02 +08:00
Lei, HUANG
f287d3115b
chore: replace result assertions ( #1840 )
...
* s/assert!\((.*)\.is_ok\(\)\);/\1.unwrap\(\);/g
* s/assert!\((.*)\.is_some\(\)\);/\1.unwrap\(\);/g
2023-06-27 19:14:48 +08:00
LFC
fcff66e039
chore: deny unused results ( #1825 )
...
* chore: deny unused results
* rebase
2023-06-27 15:33:53 +08:00
JeremyHi
e47ef1f0d2
chore: minor fix ( #1801 )
2023-06-20 11:03:52 +00:00
JeremyHi
323e2aed07
feat: deal with more than 128 txn ( #1799 )
2023-06-20 17:56:45 +08:00
