b719c020ba
chore: cherry pick #6540 , #6550 , #6551 , #6556 , #6563 , #6534 to v0.15 branch ( #6577 )
...
* feat: add metrics for request wait time and adjust stall metrics (#6540 )
* feat: add metric greptime_mito_request_wait_time to observe wait time
Signed-off-by: evenyag <realevenyag@gmail.com >
* feat: add worker to wait time metric
Signed-off-by: evenyag <realevenyag@gmail.com >
* refactor: rename stall gauge to greptime_mito_write_stalling_count
Signed-off-by: evenyag <realevenyag@gmail.com >
* feat: change greptime_mito_write_stall_total to total stalled requests
Signed-off-by: evenyag <realevenyag@gmail.com >
* refactor: merge lazy static blocks
Signed-off-by: evenyag <realevenyag@gmail.com >
---------
Signed-off-by: evenyag <realevenyag@gmail.com >
* fix: estimate mem size for bulk ingester (#6550 )
Signed-off-by: evenyag <realevenyag@gmail.com >
* fix: flow mirror cache (#6551 )
* fix: invalid cache when flownode change address
Signed-off-by: discord9 <discord9@163.com >
* update comments
Signed-off-by: discord9 <discord9@163.com >
* fix
Signed-off-by: discord9 <discord9@163.com >
* refactor: add log&rename
Signed-off-by: discord9 <discord9@163.com >
* stuff
Signed-off-by: discord9 <discord9@163.com >
---------
Signed-off-by: discord9 <discord9@163.com >
Signed-off-by: evenyag <realevenyag@gmail.com >
* feat: impl timestamp function for promql (#6556 )
* feat: impl timestamp function for promql
Signed-off-by: Dennis Zhuang <killme2008@gmail.com >
* chore: style and typo
Signed-off-by: Dennis Zhuang <killme2008@gmail.com >
* fix: test
Signed-off-by: Dennis Zhuang <killme2008@gmail.com >
* docs: update comments
Signed-off-by: Dennis Zhuang <killme2008@gmail.com >
* chore: comment
Signed-off-by: Dennis Zhuang <killme2008@gmail.com >
---------
Signed-off-by: Dennis Zhuang <killme2008@gmail.com >
Signed-off-by: evenyag <realevenyag@gmail.com >
* feat: MergeScan print input (#6563 )
* feat: MergeScan print input
Signed-off-by: discord9 <discord9@163.com >
* test: fix ut
Signed-off-by: discord9 <discord9@163.com >
---------
Signed-off-by: discord9 <discord9@163.com >
Signed-off-by: evenyag <realevenyag@gmail.com >
* fix: aggr group by all partition cols use partial commutative (#6534 )
* fix: aggr group by all partition cols use partial commutative
Signed-off-by: discord9 <discord9@163.com >
* test: bugged case
Signed-off-by: discord9 <discord9@163.com >
* test: sqlness fix
Signed-off-by: discord9 <discord9@163.com >
* test: more redacted
Signed-off-by: discord9 <discord9@163.com >
* more cases
Signed-off-by: discord9 <discord9@163.com >
* even more test cases
Signed-off-by: discord9 <discord9@163.com >
* join testcase
Signed-off-by: discord9 <discord9@163.com >
* fix: column requirement added in correct location
Signed-off-by: discord9 <discord9@163.com >
* fix test
Signed-off-by: discord9 <discord9@163.com >
* chore: clippy
Signed-off-by: discord9 <discord9@163.com >
* track col reqs per stack
Signed-off-by: discord9 <discord9@163.com >
* fix: continue
Signed-off-by: discord9 <discord9@163.com >
* chore: clippy
Signed-off-by: discord9 <discord9@163.com >
* refactor: test mod
Signed-off-by: discord9 <discord9@163.com >
* test utils
Signed-off-by: discord9 <discord9@163.com >
* test: better test
Signed-off-by: discord9 <discord9@163.com >
* more testcases
Signed-off-by: discord9 <discord9@163.com >
* test limit push down
Signed-off-by: discord9 <discord9@163.com >
* more testcases
Signed-off-by: discord9 <discord9@163.com >
* more testcase
Signed-off-by: discord9 <discord9@163.com >
* more test
Signed-off-by: discord9 <discord9@163.com >
* chore: update sqlness
Signed-off-by: discord9 <discord9@163.com >
* chore: update commnets
Signed-off-by: discord9 <discord9@163.com >
* fix: check col reqs from bottom to upper
Signed-off-by: discord9 <discord9@163.com >
* chore: more comment
Signed-off-by: discord9 <discord9@163.com >
* docs: more todo
Signed-off-by: discord9 <discord9@163.com >
* chore: comments
Signed-off-by: discord9 <discord9@163.com >
* test: a new failing test that should be fixed
Signed-off-by: discord9 <discord9@163.com >
* fix: part col alias tracking
Signed-off-by: discord9 <discord9@163.com >
* chore: unused
Signed-off-by: discord9 <discord9@163.com >
* chore: clippy
Signed-off-by: discord9 <discord9@163.com >
* docs: comment
Signed-off-by: discord9 <discord9@163.com >
* mroe testcase
Signed-off-by: discord9 <discord9@163.com >
* more testcase for step/part aggr combine
Signed-off-by: discord9 <discord9@163.com >
* FIXME: a new bug
Signed-off-by: discord9 <discord9@163.com >
* literally unfixable
Signed-off-by: discord9 <discord9@163.com >
* chore: remove some debug print
Signed-off-by: discord9 <discord9@163.com >
---------
Signed-off-by: discord9 <discord9@163.com >
Signed-off-by: evenyag <realevenyag@gmail.com >
---------
Signed-off-by: evenyag <realevenyag@gmail.com >
Signed-off-by: discord9 <discord9@163.com >
Signed-off-by: Dennis Zhuang <killme2008@gmail.com >
Co-authored-by: fys <40801205+fengys1996@users.noreply.github.com >
Co-authored-by: discord9 <55937128+discord9@users.noreply.github.com >
Co-authored-by: dennis zhuang <killme2008@gmail.com >
2025-07-23 22:29:14 +08:00
0e249f69cd
fix: don't transform Limit in TypeConversionRule, StringNormalizationRule and DistPlannerAnalyzer ( #5472 )
...
* fix: do not transform exprs in the limit plan
* chore: keep some logs for debug
* feat: workaround for limit in other rules
* test: add sqlness tests for offset 0
* chore: add fixme
2025-02-05 11:30:24 +00:00
314f2704d4
build(deps): update datafusion to latest and arrow to 51.0 ( #3661 )
...
* chore: update datafusion
* update sqlness case of time.sql
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix: adjust range query partition
* fix: hisogram incorrect result
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix: ignore filter pushdown temporarily
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix: update limit sqlness result
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix: histogram with wrong distribution
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix: update negative ordinal sqlness case
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* feat: bump df to cd7a00b
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* resolve conflicts
* ignore test_range_filter
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix promql exec panic
* fix "select count(*)" exec error
* re-enable the "test_range_filter" test since the filter push down seems not necessary to be removed
* fix: range query schema error
* update sqlness results
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* resolve conflicts
* update datafusion, again
* fix pyo3 compile error, and update some sqlness results
* update decimal sqlness cases
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix: promql literal
* fix udaf tests
* fix filter pushdown sqlness tests
* fix?: test_cast
* fix: rspy test fail due to datafusion `sin` signature change
* rebase main to see if there are any failed tests
* debug ci
* debug ci
* debug ci
* enforce input partition
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* debug ci
* fix ci
* fix ci
* debug ci
* debug ci
* debug ci
* fix sqlness
* feat: do not return error while creating a filter
* chore: remove array from error
* chore: replace todo with unimplemented
* Update src/flow/clippy.toml
Co-authored-by: Yingwen <realevenyag@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: WUJingdi <taylor-lagrange@qq.com >
Co-authored-by: discord9 <discord9@163.com >
Co-authored-by: evenyag <realevenyag@gmail.com >
Co-authored-by: tison <wander4096@gmail.com >
2024-04-18 12:07:18 +00:00
10ecc30817
feat: pushdown aggr, limit and sort plan ( #2495 )
...
* check partition for aggr plan
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* handle empty partition rule
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* remove CheckPartition option
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add test
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update some valid sqlness result
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* opt-out promql plan and update sqlness
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix limit
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix insert select subquery
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update unit test result
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix typo
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* Update src/query/src/dist_plan/analyzer.rs
Co-authored-by: Yingwen <realevenyag@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: Yingwen <realevenyag@gmail.com >
2023-09-28 06:35:45 +00:00
5bd80a74ab
feat: prepare for implementing considering partition key in the distributed planner ( #2000 )
...
* basic impl
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix frontend logic
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add sqlness test
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* check substrait compatibility before pushdown
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* going to revert some rules
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update sqlness result
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix test and clippy
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix compile error
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix typo
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* remove println
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* Apply suggestions from code review
Co-authored-by: Yingwen <realevenyag@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: Yingwen <realevenyag@gmail.com >
2023-07-31 12:36:23 +00:00
ff2784da0f
test: add SELECT ... LIMIT ... test cases for distributed mode ( #1419 )
2023-04-18 23:05:43 +08:00
184ca78a4d
revert: removed all "USE"s in sqlness tests introduced in #922 ( #938 )
2023-02-03 15:44:58 +08:00
af935671b2
feat: support "use" in GRPC requests ( #922 )
...
* feat: support "use catalog and schema"(behave like the "use" in MySQL) in GRPC requests
* fix: rebase develop
2023-02-02 20:02:56 +08:00
9428e70971
feat: integration test ( #770 )
...
* feat: add insert test cases
* fix: update results after rebase develop
* feat: supports unsigned integer types and big_insert test
* test: add insert_invalid test
* feat: supports time index constraint for bigint type
* chore: time index column at last
* test: adds more order, limit test
* fix: style
* feat: adds numbers table in standable memory catalog mode
* feat: enable fail_fast and test_filter in sqlness
* feat: add more tests
* fix: test_filter
* test: add alter tests
* feat: supports if_not_exists when create database
* test: filter_push_down and catalog test
* fix: compile error
* fix: delete output file
* chore: ignore integration test output in git
* test: update all integration test results
* fix: by code review
* chore: revert .gitignore
* feat: sort the show tables/databases results
* chore: remove issue link
* fix: compile error and code format after rebase
* test: update all integration test results
2023-01-10 18:15:50 +08:00
Yingwen
LFC
Ruihang Xia
LFC
dennis zhuang