WU Jingdi
fb4da05f25
fix: adjust fill behavior of range query ( #3489 )
2024-03-13 09:20:34 +00:00
shuiyisong
aa953dcc34
fix: impl RecordBatchStream method explicitly ( #3482 )
...
fix: impl RecordBatchStream method explicitly
2024-03-11 09:07:10 +00:00
shuiyisong
0bb949787c
refactor: introduce new Output with OutputMeta ( #3466 )
...
* refactor: introduce new output struct
* chore: add helper function
* chore: update comment
* chore: update commit
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
* chore: rename according to cr
---------
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
2024-03-11 02:24:09 +00:00
WU Jingdi
8c37c3fc0f
feat: support first_value/last_value in range query ( #3448 )
...
* feat: support `first_value/last_value` in range query
* chore: add sqlness test on `count`
* chore: add test
2024-03-11 01:30:39 +00:00
WU Jingdi
53f2a5846c
feat: support tracing rule sampler ( #3405 )
...
* feat: support tracing rule sampler
* chore: simplify code
2024-03-05 15:40:02 +08:00
Yingwen
49157868f9
feat: Correct server metrics and add more metrics for scan ( #3426 )
...
* feat: drop timer on stream terminated
* refactor: combine metrics into a histogram vec
* refactor: frontend grpc metrics
* feat: add metrics middleware layer to grpc server
* refactor: move http metrics layer to metrics mod
* feat: bucket for grpc/http elapsed
* feat: remove duplicate metrics
* style: fix cilppy
* fix: incorrect bucket of promql series
* feat: more metrics for mito
* feat: convert cost
* test: fix metrics test
2024-03-04 10:15:10 +00:00
dennis zhuang
e6819412c5
refactor: show tables and show databases ( #3423 )
...
* refactor: show tables and show databases
* chore: clean code
2024-03-04 06:15:17 +00:00
Eugene Tolbakov
8609977b52
feat: add verbose support for tql explain/analyze ( #3390 )
...
* feat: add verbose support for tql explain/analyze
* chore: apply clippy suggestions
* feat: add sqlness tests
* fix: adjust sqlness replace rules
* fix: address CR (move tql explain/analyze inside common folder)
* fix: address CR(improve comments to indicate that verbose is optional)
2024-03-02 11:18:22 +00:00
Kould
00cbbc97ae
feat: support Create Table ... Like ( #3372 )
...
* feat: support `Create Table ... Like`
* fix: `check_permission` for `Create Table ... Like`
* style: renaming `name` -> `table_name` & `target` -> `source_name` and make `Create Table ... Like` testcase more complicated
* rebase
* avoid _ fn
Signed-off-by: tison <wander4096@gmail.com >
---------
Signed-off-by: tison <wander4096@gmail.com >
Co-authored-by: tison <wander4096@gmail.com >
2024-03-02 06:34:13 +00:00
dennis zhuang
564fe3beca
feat: impl migrate_region and procedure_state SQL function ( #3325 )
...
* fix: logical region can't find region routes
* feat: fetch partitions info in batch
* refactor: rename batch functions
* refactor: rename DdlTaskExecutor to ProcedureExecutor
* feat: impl migrate_region and query_procedure_state for ProcedureExecutor
* feat: adds SQL function procedure_state and finish migrate_region impl
* fix: constant vector
* feat: unit tests for migrate_region and procedure_state
* test: test region migration by SQL
* fix: compile error after rebeasing
* fix: clippy warnings
* feat: ensure procedure_state and migrate_region can be only called under greptime catalog
* fix: license header
2024-02-22 02:37:11 +00:00
SteveLauC
e9a2b0a9ee
chore: use workspace-wide lints ( #3352 )
...
* chore: use workspace-wide lints
* respond to review
2024-02-22 01:01:10 +00:00
shuiyisong
bf5e1905cd
refactor: bring metrics to http output ( #3247 )
...
* refactor: bring metrics to http output
* chore: remove unwrap
* chore: make walk plan accumulate
* chore: change field name and comment
* chore: add metrics to http resp header
* chore: move PrometheusJsonResponse to a separate file and impl IntoResponse
* chore: put metrics in prometheus resp header too
2024-02-20 03:25:18 +00:00
Ruihang Xia
72cd443ba3
feat: organize tracing on query path ( #3310 )
...
* feat: organize tracing on query path
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* warp json conversion to TracingContext's methods
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* remove unnecessary .trace()
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* Update src/query/src/dist_plan/merge_scan.rs
Co-authored-by: Zhenchi <zhongzc_arch@outlook.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: Zhenchi <zhongzc_arch@outlook.com >
2024-02-18 15:04:57 +00:00
tison
4e04a4e48f
build: support build without git ( #3309 )
...
* build: support build without git
Signed-off-by: tison <wander4096@gmail.com >
* chore
Signed-off-by: tison <wander4096@gmail.com >
* address comment
Signed-off-by: tison <wander4096@gmail.com >
* fix syntax
Signed-off-by: tison <wander4096@gmail.com >
---------
Signed-off-by: tison <wander4096@gmail.com >
2024-02-18 10:30:01 +00:00
dennis zhuang
e5ec65988b
feat: administration functions ( #3236 )
...
* feat: adds database() function to return current db
* refactor: refactor meta src and client with new protos
* feat: impl migrate_region and query_procedure_state for procedure service/client
* fix: format
* temp commit
* feat: impl migrate_region SQL function
* chore: clean code for review
* fix: license header
* fix: toml format
* chore: update proto dependency
* chore: apply suggestion
Co-authored-by: Weny Xu <wenymedia@gmail.com >
* chore: apply suggestion
Co-authored-by: Weny Xu <wenymedia@gmail.com >
* chore: apply suggestion
Co-authored-by: JeremyHi <jiachun_feng@proton.me >
* chore: apply suggestion
Co-authored-by: fys <40801205+fengys1996@users.noreply.github.com >
* chore: print key when parsing procedure id fails
* chore: comment
* chore: comment for MigrateRegionFunction
---------
Co-authored-by: Weny Xu <wenymedia@gmail.com >
Co-authored-by: JeremyHi <jiachun_feng@proton.me >
Co-authored-by: fys <40801205+fengys1996@users.noreply.github.com >
2024-02-07 01:12:32 +00:00
dennis zhuang
7323e9b36f
feat: change Range Query’s default align behavior aware of timezone ( #3219 )
...
* feat: change Range Query’s default align behavior to 1970-01-01 00:00:00 aware of timezone
* test: test with +23:00 timezone
2024-01-24 08:17:57 +00:00
dennis zhuang
6a12c27e78
feat: make query be aware of timezone setting ( #3175 )
...
* feat: let TypeConversionRule aware query context timezone setting
* chore: don't optimize explain command
* feat: parse string into timestamp with timezone
* fix: compile error
* chore: check the scalar value type in predicate
* chore: remove mut for engine context
* chore: return none if the scalar value is utf8 in time range predicate
* fix: some fixme
* feat: let Date and DateTime parsing from string value be aware of timezone
* chore: tweak
* test: add datetime from_str test with timezone
* feat: construct function context from query context
* test: add timezone test for to_unixtime and date_format function
* fix: typo
* chore: apply suggestion
* test: adds string with timezone
* chore: apply CR suggestion
Co-authored-by: Lei, HUANG <6406592+v0y4g3r@users.noreply.github.com >
* chore: apply suggestion
---------
Co-authored-by: Lei, HUANG <6406592+v0y4g3r@users.noreply.github.com >
2024-01-22 14:14:03 +00:00
dennis zhuang
5e89472b2e
feat: adds parse options for SQL parser ( #3193 )
...
* feat: adds parse options for parser and timezone to scan request
* chore: remove timezone in ScanRequest
* feat: remove timezone in parse options and adds type checking to parititon columns
* fix: comment
* chore: apply suggestions
Co-authored-by: Yingwen <realevenyag@gmail.com >
* fix: format
---------
Co-authored-by: Yingwen <realevenyag@gmail.com >
2024-01-19 09:16:36 +00:00
shuiyisong
a29b9f71be
chore: carry metrics in flight metadata from datanode to frontend ( #3113 )
...
* chore: carry metrics in flight metadata from datanode to frontend
* chore: fix typo
* fix: ignore metric flight message on client
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* chore: add cr comment
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
* chore: add cr comment
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
* chore: update proto
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
2024-01-17 11:38:03 +00:00
WU Jingdi
816d94892c
feat: support HTTP&gRPC&pg set timezone ( #3125 )
...
* feat: support HTTP&gRPC&pg set timezone
* chore: fix code advice
* chore: fix code advice
2024-01-15 06:29:31 +00:00
Ning Sun
1fc168bf6a
feat: update our cross schema check to cross catalog ( #3123 )
2024-01-09 09:38:48 +00:00
Ruihang Xia
af0c4c068a
feat: support PromQL function vector ( #3036 )
...
* produce vector plan
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* work with OR
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* apply review sugg
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* move common const strings to common_query
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add comment for GREPTIME_COUNT
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2024-01-09 03:44:00 +00:00
zyy17
a89840f5f9
refactor(metrics): add 'greptime_' prefix for every metrics ( #3093 )
...
* refactor(metrics): add 'greptimedb_' prefix for every metrics
* chore: use 'greptime_' as prefix
* chore: add some prefix for new metrics
* chore: fix format error
2024-01-05 08:12:23 +00:00
niebayes
7d509e97f6
chore: move some commonly referenced crates to workspace Cargo.toml ( #2981 )
...
fix: resolve conflicts
2023-12-22 09:13:18 +00:00
Ruihang Xia
6b8dbcfb54
chore: update toolchain to 20231219 ( #2932 )
...
* update toolchain file, remove unused feature gates
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix clippy
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix format
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update action file
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update to 12-19
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-12-19 07:24:08 +00:00
WU Jingdi
d180e41230
fix: change range query time slot to [align_ts, align_ts + range) ( #2938 )
2023-12-19 02:35:14 +00:00
WU Jingdi
4383a69876
fix!: remove range calendar as To option ( #2940 )
...
fix: remove range calendar as `To` option
2023-12-18 07:48:49 +00:00
WU Jingdi
370ec04a9d
fix: use linear interpolation to implement range LINEAR fill strategy ( #2903 )
...
* fix: use linear interpolation to implement range LINEAR fill strategy
* chore: update test case
* chore: optimize linear interpolation implementation
* chore: update test and add comment
2023-12-13 09:53:35 +00:00
Yue Deng
3d651522c2
feat: add build() function to return the database build info ( #2919 )
...
* feat: add build function and register it
build() function to return the database build info #2909
* refactor: fix typos and change code structure
* test: add test for build()
* refactor: cargo fmt and eliminate warnings
* Apply suggestions from code review
Co-authored-by: Weny Xu <wenymedia@gmail.com >
* refactor: move system.sql to a new directory
---------
Co-authored-by: Weny Xu <wenymedia@gmail.com >
2023-12-13 09:02:00 +00:00
Ruihang Xia
8a74bd36f5
style: rename *Adaptor to *Adapter ( #2914 )
...
* rename RecordBatchStreamAdaptor to RecordBatchStreamWrapper
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* rename ServerSqlQueryHandlerAdaptor to ServerSqlQueryHandlerAdapter
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-12-12 09:45:09 +00:00
dennis zhuang
cf8b6c77dc
chore: clean up unused errors ( #2901 )
2023-12-11 09:08:50 +00:00
Yingwen
6a57f4975e
perf(mito): scan SSTs and memtables in parallel ( #2852 )
...
* feat: seq scan support parallelism
* feat: scan region by parallelism in config
* feat: enlarge channel size
* chore: parallel builder logs
* feat: use parallel reader accroding to source num
* chore: 128 channel size
* feat: add fetch cost metrics
* feat: add channel size to config
* feat: builder cost
* feat: logs
* feat: compiler error
* feat: fetch cost
* feat: convert cost
* chore: Revert "feat: logs"
This reverts commit 01e0df2c3a
2023-12-11 06:43:17 +00:00
Ruihang Xia
d6ef7a75de
fix: type conversion rule reverses operands ( #2871 )
...
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-12-05 03:25:29 +00:00
WU Jingdi
806400caff
feat: add align to / interval support in range query ( #2842 )
...
* feat: add align to / interval support in range query
* chore: fix ci
* chore: simplify `parse_duration_expr`
* chore: change s to ms
2023-12-04 08:00:41 +00:00
Wei
fe2fc723bc
refactor: DataType name function ( #2836 )
...
* refactor: DataType name function
* chore: test case
2023-11-30 03:49:09 +00:00
Ruihang Xia
56fc77e573
fix: add missing error display message ( #2791 )
...
* fix: add missing error display message
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update sqlness result
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-11-23 02:59:49 +00:00
WU Jingdi
91820a8006
fix: empty by in range query ( #2770 )
...
* fix: empty by in range query
* Apply suggestions from code review
---------
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
2023-11-17 11:18:14 +00:00
WU Jingdi
500e299e40
feat: Enable distributed tracing in greptimedb ( #2755 )
...
* feat: implement distributed tracing
* fix: change usage of span
* fix: use otlp as exporter
* chore: update dependence
* chore: add span info
* chore: add alias
* chore: use instrument instead of trace
2023-11-17 08:51:57 +00:00
Ruihang Xia
ac4b6cd7f0
feat: write logical region to metric engine ( #2759 )
...
* transform write request
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add tests for put request
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* use table_id instead of metric_name
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix typo
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* CR sugg.
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* define random state as const
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-11-17 07:44:11 +00:00
Ruihang Xia
f02dc0e274
feat: run dist planner after simplify expression rule ( #2723 )
...
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-11-09 12:44:50 +00:00
tison
0cd6dacb45
chore: multiple licenses fixes ( #2714 )
...
* chore: avoid license risk from akka
Signed-off-by: tison <wander4096@gmail.com >
* chore: LICENSE test is AS IS
Signed-off-by: tison <wander4096@gmail.com >
* ci: use hawkeye to pin in inceptionYear
Signed-off-by: tison <wander4096@gmail.com >
* add instruction for running license header apply
Signed-off-by: tison <wander4096@gmail.com >
---------
Signed-off-by: tison <wander4096@gmail.com >
2023-11-09 10:38:12 +00:00
Ruihang Xia
93f21b188d
chore: unify workspace dependencies and remove some unused ( #2713 )
...
* log-store
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* base64
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* udeps
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* snafu
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* snafu style
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* change the workspace deps' style
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-11-09 07:34:22 +00:00
WU Jingdi
180bc64cb0
feat: change metric crate from metrics to prometheus ( #2655 )
...
* feat: change metrics to prometheus
* chore: fix code advise
* chore: resolve merge conflict
* chore: fix code advise
2023-10-31 15:46:57 +00:00
WU Jingdi
d2f3793d15
fix: explain range query ( #2664 )
...
* fix: explain range query
* chore: add comment
2023-10-30 13:21:25 +00:00
Ruihang Xia
5d8b0e8154
chore: bump dependencies ( #2659 )
...
* fix all hard error
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix nextest
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* trivial changes
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix order by
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix sql keyword and data type
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix range exec's input partitioning
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix cover input type
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix explain analyze
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update distributed mode sqlness result
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix lints
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update locks
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* downgrade dlv-list
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-10-26 12:24:14 +00:00
Ning Sun
0fbde48655
feat: hide internal error and unknown error message from end user ( #2544 )
...
* feat: use fixed error message for unknown error
* feat: return fixed message for internal error as well
* chore: include status code in error message
* test: update tests for asserts of error message
* feat: change status code of some datafusion error
* fix: make CollectRecordbatch an query error
* test: update sqlness results
2023-10-23 03:07:35 +00:00
WU Jingdi
46e106bcc3
feat: allow nest range expr in Range Query ( #2557 )
...
* feat: eable range expr nest
* fix: change range expr rewrite format
* chore: organize range query tests
* chore: change range expr name(e.g. MAX(v) RANGE 5s FILL 6)
* chore: add range query test
* chore: fix code advice
* chore: fix ca
2023-10-18 07:03:26 +00:00
Ruihang Xia
07be50403e
feat: add basic metrics to query ( #2559 )
...
* add metrics to merge scan
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* count series in promql
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* tweak label name
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* tweak label name
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* document metric label
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-10-10 06:55:25 +00:00
shuiyisong
007f7ba03c
refactor: extract plugins crate ( #2487 )
...
* chore: move frontend plugins fn
* chore: move datanode plugins to fn
* chore: add opt plugins
* chore: add plugins to meta-srv
* chore: setup meta plugins, wait for router extension
* chore: try use configurator for grpc too
* chore: minor fix fmt
* chore: minor fix fmt
* chore: add start meta_srv for hook
* chore: merge develop
* chore: minor fix
* chore: replace Arc<Plugins> with PluginsRef
* chore: fix header
* chore: remove empty file
* chore: modify comments
* chore: remove PluginsRef type alias
* chore: remove `OptPlugins`
2023-10-09 04:54:27 +00:00
Ruihang Xia
d5e4fcaaff
feat: dist plan optimize part 2 ( #2543 )
...
* allow udf and scalar fn
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* put CountWildcardRule before dist planner
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* bump datafusion to fix first_value/last_value
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update sqlness result
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* use retain instead
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-10-09 02:18:36 +00:00
