08263995f6
feat: implement the FrontendInvoker ( #3824 )
...
* chore: add `common-frontend`
* feat: add `FrontendInvoker` trait
* feat: implement the `FrontendInvoker`
2024-04-28 11:11:34 +00:00
3112ced9c0
chore: rename all datanode_manager to node_manager ( #3813 )
2024-04-28 02:34:06 +00:00
eb3d2ca759
refactor: refactor DatanodeManager to NodeManager ( #3811 )
...
* chore: bump greptime-proto to 2c14c6e
* refactor: refactor `DatanodeManager` to `NodeManager`
2024-04-26 11:31:03 +00:00
4eadd9f8a8
refactor: log statement on error by Display ( #3803 )
...
* refactor: log statement on error by Display
Signed-off-by: tison <wander4096@gmail.com >
* Apply suggestions from code review
Co-authored-by: Yingwen <realevenyag@gmail.com >
Signed-off-by: tison <wander4096@gmail.com >
---------
Signed-off-by: tison <wander4096@gmail.com >
Co-authored-by: Yingwen <realevenyag@gmail.com >
2024-04-26 04:05:13 +00:00
1ec595134d
feat: define CreateFlowTask and DropFlowTask ( #3801 )
...
* chore: bump proto to cefc73f
* feat: add `CreateFlowTask` and `DropFlowTask`
* chore: bump to 87f2b38
* chore: bump to 783682f
2024-04-25 12:30:31 +00:00
bba3108e0d
refactor!: unify sql options into OptionMap ( #3792 )
...
* unify sql options into OptionMap
Signed-off-by: tison <wander4096@gmail.com >
* fixup
Signed-off-by: tison <wander4096@gmail.com >
* Update src/sql/src/util.rs
* drop legacy regions option
Signed-off-by: tison <wander4096@gmail.com >
* fixup
Signed-off-by: tison <wander4096@gmail.com >
* fixup
Signed-off-by: tison <wander4096@gmail.com >
---------
Signed-off-by: tison <wander4096@gmail.com >
2024-04-25 04:06:05 +00:00
8f2ce4abe8
feat: impl show collation and show charset statements ( #3753 )
...
* feat: impl show collation and show charset statements
* docs: add api docs
2024-04-20 06:01:32 +00:00
4248dfcf36
feat: support invalidate schema name key cache ( #3725 )
...
* feat: support invalidate schema name key cache
* fix: remove pub for invalidate_schema_cache
* refactor: add DropMetadataBroadcast State Op
* fix: delete files
2024-04-18 04:02:06 +00:00
50ae4dc174
refactor: merge RegionHandleResult into RegionHandleResponse ( #3721 )
...
* refactor: merge RegionHandleResult into RegionHandleResponse
Signed-off-by: tison <wander4096@gmail.com >
* RegionResponse to api::region
Signed-off-by: tison <wander4096@gmail.com >
* order
Signed-off-by: tison <wander4096@gmail.com >
---------
Signed-off-by: tison <wander4096@gmail.com >
2024-04-17 10:03:20 +00:00
bbea651d08
feat(promql): parameterize lookback ( #3630 )
...
* feat(promql): parameterize lookback
* chore(promql): address CR, adjusted sqlness
* chore(promql): fmt
* chore(promql): fix accidental removal
* fix(promql): address CR
* fix(promql): address CR
* feat(promql): add initial lookback parameter grpc support
* fix: update greptime-proto revision
* chore: restore accidental removal
2024-04-15 09:11:21 +00:00
7a04bfe50a
feat: add strict mode to validate protocol strings ( #3638 )
...
* feat: add strict mode to validate protocol strings
* hotfix: fix test
* fix: fix return pair and test param
* test: add test for utf-8 validation
* fix: cargo check
* Update src/servers/src/prom_row_builder.rs
Co-authored-by: Eugene Tolbakov <ev.tolbakov@gmail.com >
* fix: fix param of without_strict_mode
* fix: change field name in HttpOptions
* fix: replace if else with match
* fix: replace all strict_mode with is_stirct_mode
* fix: fix test_config_api
* fix: fix bench, add vm handshake, catch error
---------
Co-authored-by: Eugene Tolbakov <ev.tolbakov@gmail.com >
Co-authored-by: tison <wander4096@gmail.com >
2024-04-15 07:53:48 +00:00
544c4a70f8
refactor: check error type before logging ( #3697 )
...
* refactor: check error type before logging
* chore: update log level for broken pipe
* refactor: leave a debugging output for non critial error
2024-04-12 02:18:14 +00:00
34f935df66
chore: create database api change in protobuf ( #3682 )
2024-04-09 12:11:38 +00:00
12286f07ac
feat: cluster information ( #3631 )
...
* chore: keep the same method order in KvBackend
* feat: make meta client can get all node info of cluster
* feat: cluster info data model
* feat: frontend and datanode info
* feat: list node info
* chore: remove the method: is_started
* fix: scan key prefix
* chore: impl From for NodeInfoKey
* chore: doc for trait and struct
* chore: reuse the error
* chore: refactor two collec cluster info handlers
* chore: remove inline
* chore: refactor two collec cluster info handlers
2024-04-08 07:48:36 +00:00
4a5bb698a9
feat: impl show index and show columns ( #3577 )
...
* feat: impl show index and show columns
* fix: show index from database
* fix: canonicalize table name
* refactor: show parsers
2024-03-29 18:34:52 +00:00
63681f0e4d
refactor(table): remove unused table requests ( #3603 )
...
* refactor(table): remove unused requests
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* update comments
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: clippy
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: compile
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
---------
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
2024-03-28 11:31:14 +00:00
92a8e863de
chore: do not reply for broadcast msg ( #3595 )
2024-03-27 11:39:23 +00:00
58c7858cd4
feat: update physical table schema on alter logical tables ( #3585 )
...
* feat: update physical table schema on alter
* feat: alter logical table in sql path
* feat: invalidate cache step1
* feat: invalidate cache step2
* feat: invalidate cache step3
* feat: invalidate cache step4
* fix: failed ut
* fix: standalone cache invalidator
* feat: log the count of already finished
* feat: re-invalidate cache
* chore: by comment
* chore: Update src/common/meta/src/ddl/create_logical_tables.rs
---------
Co-authored-by: Yingwen <realevenyag@gmail.com >
2024-03-26 14:29:53 +00:00
dd18d8c97b
build(deps): remove some unused dependencies ( #3582 )
...
* build(deps): remove some unused dependencies
* add `arc-swap` dependency back
2024-03-26 12:48:28 +00:00
2b2fd80bf4
feat: return new added columns in region server's extension response ( #3533 )
...
* feat: adapt the new proto response
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update interfaces
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* write columns to extension
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* use physical column's schema
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* sort logical columns by name
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* format code
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* return physical table's column
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* Update src/common/meta/src/datanode_manager.rs
Co-authored-by: JeremyHi <jiachun_feng@proton.me >
* implement sort column logic
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* proxy create table procedure to create logical table
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add unit test for sort_columns
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update sqlness cases
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: JeremyHi <jiachun_feng@proton.me >
2024-03-23 09:31:16 +00:00
86fb9d8ac7
refactor: remove redudant PromStoreProtocolHandler::write ( #3553 )
...
refactor: remove redudant PromStoreProtocolHandler::write API and rename PromStoreProtocolHandler::write_fast to write
2024-03-22 02:09:00 +00:00
856a4e1e4f
refactor: refactor CacheInvalidator ( #3550 )
...
* refactor: refactor InvalidateCache Instruction
* refactor: refactor CacheInvalidator
2024-03-20 10:18:28 +00:00
3acd5bfad0
chore: http header with metrics ( #3536 )
...
* chore: bring write cost to output
* chore: add write cost to greptimev1result
* chore: add metrics to influxdb write resp header
* chore: add metrics to prom store
* chore: add metrics to otlp
* chore: add debug log
* fix: prom remote read with output
* fix: prom queries don't output metrics header
* chore: extract header value
* chore: refactor code
* chore: fix cr issue
2024-03-18 11:21:19 +00:00
a52aedec5b
feat: implement the drop database parser ( #3521 )
...
* refactor: refactor drop table parser
* feat: implement drop database parser
* fix: canonicalize name of create database
* test: update sqlness result
* Update src/operator/src/statement.rs
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
---------
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
2024-03-15 06:15:18 +00:00
0bb949787c
refactor: introduce new Output with OutputMeta ( #3466 )
...
* refactor: introduce new output struct
* chore: add helper function
* chore: update comment
* chore: update commit
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
* chore: rename according to cr
---------
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
2024-03-11 02:24:09 +00:00
02b18fbca1
feat: decode prom requests to grpc ( #3425 )
...
* hack: inline decode
* move to servers
* fix: samples lost
* add bench
* remove useless functions
* wip
* feat: remove object pools
* fix: minor issues
* fix: remove useless dep
* chore: rebase main
* format
* finish
* fix: format
* feat: introduce request pool
* try to fix license issue
* fix: clippy
* resolve comments
* fix:typo
* remove useless comments
2024-03-05 09:47:32 +00:00
7b1c3503d0
fix: complete interceptors for all frontend entry ( #3428 )
2024-03-05 09:38:47 +00:00
53f2a5846c
feat: support tracing rule sampler ( #3405 )
...
* feat: support tracing rule sampler
* chore: simplify code
2024-03-05 15:40:02 +08:00
49157868f9
feat: Correct server metrics and add more metrics for scan ( #3426 )
...
* feat: drop timer on stream terminated
* refactor: combine metrics into a histogram vec
* refactor: frontend grpc metrics
* feat: add metrics middleware layer to grpc server
* refactor: move http metrics layer to metrics mod
* feat: bucket for grpc/http elapsed
* feat: remove duplicate metrics
* style: fix cilppy
* fix: incorrect bucket of promql series
* feat: more metrics for mito
* feat: convert cost
* test: fix metrics test
2024-03-04 10:15:10 +00:00
00cbbc97ae
feat: support Create Table ... Like ( #3372 )
...
* feat: support `Create Table ... Like`
* fix: `check_permission` for `Create Table ... Like`
* style: renaming `name` -> `table_name` & `target` -> `source_name` and make `Create Table ... Like` testcase more complicated
* rebase
* avoid _ fn
Signed-off-by: tison <wander4096@gmail.com >
---------
Signed-off-by: tison <wander4096@gmail.com >
Co-authored-by: tison <wander4096@gmail.com >
2024-03-02 06:34:13 +00:00
d4a54a085b
feat: add configuration for tls watch option ( #3395 )
...
* feat: add configuration for tls watch option
* test: sleep longer to ensure async task run
* test: update config api integration test
* refactor: rename function
2024-03-01 03:49:54 +00:00
4b36c285f1
feat: flush or compact table and region functions ( #3363 )
...
* feat: adds Requester to process table flush and compaction request
* feat: admin_fn macros for administration functions
* test: add query result
* feat: impl flush_region, flush_table, compact_region, and flush_region functions
* docs: add Arguments to admin_fn macro
* chore: apply suggestion
Co-authored-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: apply suggestion
Co-authored-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: group_requests_by_peer and adds log
* Update src/common/macro/src/admin_fn.rs
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
* feat: adds todo for spawan thread
* feat: rebase with main
---------
Co-authored-by: Zhenchi <zhongzc_arch@outlook.com >
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
2024-02-27 08:57:38 +00:00
3887d207b6
feat: make tls certificates/keys reloadable (part 1) ( #3335 )
...
* feat: make tls certificates/keys reloadable (part 1)
* feat: add notify watcher for cert/key files
* test: add unit test for watcher
* fix: correct usage of watcher
* fix: skip watch when tls disabled
2024-02-26 09:37:54 +00:00
2035e7bf4c
refactor: set the actual bound port in server handler ( #3353 )
...
* refactor: set the actual bound port so we can use port 0 in testing
* Update src/servers/src/server.rs
Co-authored-by: Weny Xu <wenymedia@gmail.com >
* fmt
---------
Co-authored-by: Weny Xu <wenymedia@gmail.com >
2024-02-23 02:49:11 +00:00
564fe3beca
feat: impl migrate_region and procedure_state SQL function ( #3325 )
...
* fix: logical region can't find region routes
* feat: fetch partitions info in batch
* refactor: rename batch functions
* refactor: rename DdlTaskExecutor to ProcedureExecutor
* feat: impl migrate_region and query_procedure_state for ProcedureExecutor
* feat: adds SQL function procedure_state and finish migrate_region impl
* fix: constant vector
* feat: unit tests for migrate_region and procedure_state
* test: test region migration by SQL
* fix: compile error after rebeasing
* fix: clippy warnings
* feat: ensure procedure_state and migrate_region can be only called under greptime catalog
* fix: license header
2024-02-22 02:37:11 +00:00
e9a2b0a9ee
chore: use workspace-wide lints ( #3352 )
...
* chore: use workspace-wide lints
* respond to review
2024-02-22 01:01:10 +00:00
bf5e1905cd
refactor: bring metrics to http output ( #3247 )
...
* refactor: bring metrics to http output
* chore: remove unwrap
* chore: make walk plan accumulate
* chore: change field name and comment
* chore: add metrics to http resp header
* chore: move PrometheusJsonResponse to a separate file and impl IntoResponse
* chore: put metrics in prometheus resp header too
2024-02-20 03:25:18 +00:00
4e04a4e48f
build: support build without git ( #3309 )
...
* build: support build without git
Signed-off-by: tison <wander4096@gmail.com >
* chore
Signed-off-by: tison <wander4096@gmail.com >
* address comment
Signed-off-by: tison <wander4096@gmail.com >
* fix syntax
Signed-off-by: tison <wander4096@gmail.com >
---------
Signed-off-by: tison <wander4096@gmail.com >
2024-02-18 10:30:01 +00:00
43ef0820c0
fix: SQL insertion and column default constraint aware of timezone ( #3266 )
...
* fix: missing timezone when parsing sql value to greptimedb value
* test: sql_value_to_value
* fix: column default constraint missing timezone
* test: column def default constraint with timezone
* test: adds sqlness test for default constraint aware of timezone
* fix: typo
* chore: comment
2024-01-30 09:15:38 +00:00
f81e37f508
refactor: make http server built flexibly ( #3225 )
...
* refactor: make http server built flexibly
* Apply suggestions from code review
Co-authored-by: JeremyHi <jiachun_feng@proton.me >
* fix: resolve PR comments
* Fix CI.
---------
Co-authored-by: JeremyHi <jiachun_feng@proton.me >
2024-01-24 03:45:08 +00:00
31787f4bfd
feat!: switch prom remote write to metric engine ( #3198 )
...
* feat: switch prom remote write to metric engine
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* Apply suggestions from code review
Co-authored-by: dennis zhuang <killme2008@gmail.com >
* fix compile
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* read physical table name from url
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* remove physical table from header
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix merge error
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix format
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add with_metric_engine option to config remote write behavior
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* check parameter
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add specific config param
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* default with_metric_engine to true
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update UT
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: dennis zhuang <killme2008@gmail.com >
2024-01-22 14:48:28 +00:00
6a12c27e78
feat: make query be aware of timezone setting ( #3175 )
...
* feat: let TypeConversionRule aware query context timezone setting
* chore: don't optimize explain command
* feat: parse string into timestamp with timezone
* fix: compile error
* chore: check the scalar value type in predicate
* chore: remove mut for engine context
* chore: return none if the scalar value is utf8 in time range predicate
* fix: some fixme
* feat: let Date and DateTime parsing from string value be aware of timezone
* chore: tweak
* test: add datetime from_str test with timezone
* feat: construct function context from query context
* test: add timezone test for to_unixtime and date_format function
* fix: typo
* chore: apply suggestion
* test: adds string with timezone
* chore: apply CR suggestion
Co-authored-by: Lei, HUANG <6406592+v0y4g3r@users.noreply.github.com >
* chore: apply suggestion
---------
Co-authored-by: Lei, HUANG <6406592+v0y4g3r@users.noreply.github.com >
2024-01-22 14:14:03 +00:00
3834ea7422
feat: copy database from ( #3164 )
...
* wip: impl COPY DATABASE FROM parser
* wip: impl copy database from
* wip: add some ut
* wip: add continue_on_error option
* test: add sqlness cases for copy database
* fix: trailing newline
* fix: typo
* fix: some cr comments
* chore: resolve confilicts
* fix: some cr comments
2024-01-22 06:33:54 +00:00
5e89472b2e
feat: adds parse options for SQL parser ( #3193 )
...
* feat: adds parse options for parser and timezone to scan request
* chore: remove timezone in ScanRequest
* feat: remove timezone in parse options and adds type checking to parititon columns
* fix: comment
* chore: apply suggestions
Co-authored-by: Yingwen <realevenyag@gmail.com >
* fix: format
---------
Co-authored-by: Yingwen <realevenyag@gmail.com >
2024-01-19 09:16:36 +00:00
816d94892c
feat: support HTTP&gRPC&pg set timezone ( #3125 )
...
* feat: support HTTP&gRPC&pg set timezone
* chore: fix code advice
* chore: fix code advice
2024-01-15 06:29:31 +00:00
93f28c2a37
refactor: make grpc service able to be added dynamically ( #3160 )
2024-01-15 04:33:27 +00:00
51a3fbc7bf
refactor: change how frontend grpc services are orchestrated ( #3134 )
2024-01-11 02:26:44 +00:00
1fc168bf6a
feat: update our cross schema check to cross catalog ( #3123 )
2024-01-09 09:38:48 +00:00
6e860bc0fd
feat: support grpc for otlp trace and metrics ( #3105 )
...
* feat: add grpc support for otlp trace and metrics
* cr: add some comment
* fix: ut
* fix: cr
2024-01-09 05:01:48 +00:00
a89840f5f9
refactor(metrics): add 'greptime_' prefix for every metrics ( #3093 )
...
* refactor(metrics): add 'greptimedb_' prefix for every metrics
* chore: use 'greptime_' as prefix
* chore: add some prefix for new metrics
* chore: fix format error
2024-01-05 08:12:23 +00:00
Weny Xu
tison
dennis zhuang
maco
Eugene Tolbakov
irenjj
Ning Sun
Yohan Wal
JeremyHi
Zhenchi
dimbtp
Ruihang Xia
Lei, HUANG
shuiyisong
WU Jingdi
Yingwen
Kould
LFC
SteveLauC
fys
zyy17