Yingwen
a7c22c253c
perf: Reduce fulltext bloom load time ( #6651 )
...
* perf: cached reader do not get page concurrently
Otherwise they will all fetch the same pages in parallel
Signed-off-by: evenyag <realevenyag@gmail.com >
* perf: always disable zstd for bloom
Signed-off-by: evenyag <realevenyag@gmail.com >
---------
Signed-off-by: evenyag <realevenyag@gmail.com >
2025-09-05 20:09:44 +08:00
Weny Xu
bfbd7f608a
fix: correct heartbeat stream handling logic ( #6821 )
...
* fix: correct heartbeat stream handling logic
Signed-off-by: WenyXu <wenymedia@gmail.com >
* Update src/meta-srv/src/service/heartbeat.rs
Co-authored-by: jeremyhi <jiachun_feng@proton.me >
---------
Signed-off-by: WenyXu <wenymedia@gmail.com >
Co-authored-by: jeremyhi <jiachun_feng@proton.me >
Signed-off-by: evenyag <realevenyag@gmail.com >
2025-09-05 20:09:44 +08:00
Weny Xu
64e3eb9fa2
chore: pick #6415 to release/v0.15 ( #6686 )
...
ci: add check-version script to check whether push the latast image (#6415 )
Signed-off-by: liyang <daviderli614@gmail.com >
Co-authored-by: liyang <daviderli614@gmail.com >
2025-08-07 12:57:09 +00:00
Weny Xu
6c57f4b7e4
feat: pick automated metadata recovery feature ( #6676 )
...
* feat: persist column ids in table metadata (#6457 )
* feat: persist column ids in table metadata
Signed-off-by: WenyXu <wenymedia@gmail.com >
* chore: apply suggestions from CR
Signed-off-by: WenyXu <wenymedia@gmail.com >
---------
Signed-off-by: WenyXu <wenymedia@gmail.com >
* feat: add column metadata to response extensions (#6451 )
Signed-off-by: WenyXu <wenymedia@gmail.com >
* refactor(meta): extract `AlterTableExecutor` from `AlterTableProcedure` (#6470 )
* refactor(meta): extract `AlterTableExecutor` from `AlterTableProcedure`
Signed-off-by: WenyXu <wenymedia@gmail.com >
* chore: apply suggestions from CR
Signed-off-by: WenyXu <wenymedia@gmail.com >
---------
Signed-off-by: WenyXu <wenymedia@gmail.com >
* refactor(meta): separate validation and execution logic in alter logical tables procedure (#6478 )
* refactor(meta): separate validation and execution logic in alter logical tables procedure
Signed-off-by: WenyXu <wenymedia@gmail.com >
* chore: apply suggestions from CR
Signed-off-by: WenyXu <wenymedia@gmail.com >
---------
Signed-off-by: WenyXu <wenymedia@gmail.com >
* fix: fix state transition in create table procedure (#6523 )
Signed-off-by: WenyXu <wenymedia@gmail.com >
* feat: add table reconciliation utilities (#6519 )
* feat: add table reconciliation utilities
Signed-off-by: WenyXu <wenymedia@gmail.com >
* fix: fix unit tests
Signed-off-by: WenyXu <wenymedia@gmail.com >
* chore: apply suggestison from CR
Signed-off-by: WenyXu <wenymedia@gmail.com >
* chore: apply suggestions from CR
Signed-off-by: WenyXu <wenymedia@gmail.com >
* chore: update comment
Signed-off-by: WenyXu <wenymedia@gmail.com >
---------
Signed-off-by: WenyXu <wenymedia@gmail.com >
* feat: Support ListMetadataRequest to retrieve regions' metadata (#6348 )
* feat: support list metadata in region server
Signed-off-by: evenyag <realevenyag@gmail.com >
* test: add test for list region metadata
Signed-off-by: evenyag <realevenyag@gmail.com >
* feat: return null if region not exists
Signed-off-by: evenyag <realevenyag@gmail.com >
* chore: update greptime-proto
Signed-off-by: evenyag <realevenyag@gmail.com >
---------
Signed-off-by: evenyag <realevenyag@gmail.com >
* refactor: support multiple index operations in single alter region request (#6487 )
* refactor: support multiple index operations in single alter region request
Signed-off-by: WenyXu <wenymedia@gmail.com >
* chore: apply suggestions from CR
Signed-off-by: WenyXu <wenymedia@gmail.com >
* chore: apply suggestions from CR
Signed-off-by: WenyXu <wenymedia@gmail.com >
* chore: apply suggestions from CR
Signed-off-by: WenyXu <wenymedia@gmail.com >
* chore: update greptime-proto
Signed-off-by: WenyXu <wenymedia@gmail.com >
---------
Signed-off-by: WenyXu <wenymedia@gmail.com >
* feat: implement pause/resume functionality for procedure manager (#6393 )
* feat: implement pause/resume functionality for procedure manager
Signed-off-by: WenyXu <wenymedia@gmail.com >
* chore: apply suggestions from CR
Signed-off-by: WenyXu <wenymedia@gmail.com >
* chore: apply suggestions from CR
Signed-off-by: WenyXu <wenymedia@gmail.com >
---------
Signed-off-by: WenyXu <wenymedia@gmail.com >
* feat: move metasrv admin to http server while keep tonic for backward compatibility (#6466 )
* feat: move metasrv admin to http server while keep tonic for backward compatibility
Signed-off-by: lyang24 <lanqingy93@gmail.com >
* refactor with nest method
Signed-off-by: lyang24 <lanqingy93@gmail.com >
---------
Signed-off-by: lyang24 <lanqingy93@gmail.com >
Co-authored-by: lyang24 <lanqingy@usc.edu >
* feat: allow igoring nonexistent regions in recovery mode (#6592 )
* feat: allow ignoring nonexistent regions
Signed-off-by: WenyXu <wenymedia@gmail.com >
* feat: ignore nonexistent regions during startup in recovery mode
Signed-off-by: WenyXu <wenymedia@gmail.com >
* feat: allow enabling recovery mode via http api
Signed-off-by: WenyXu <wenymedia@gmail.com >
---------
Signed-off-by: WenyXu <wenymedia@gmail.com >
* feat: allow setting next table id via http api (#6597 )
* feat: allow reset next table id via http api
Signed-off-by: WenyXu <wenymedia@gmail.com >
* chore: apply suggestions from CR
Signed-off-by: WenyXu <wenymedia@gmail.com >
* chore: apply suggesions from CR
Signed-off-by: WenyXu <wenymedia@gmail.com >
---------
Signed-off-by: WenyXu <wenymedia@gmail.com >
* feat: ignore internal keys in metadata snapshots (#6606 )
feat: ignore dumpping internal keys
Signed-off-by: WenyXu <wenymedia@gmail.com >
* feat: introduce reconcile table procedure (#6584 )
* feat: introduce `SyncColumns`
Signed-off-by: WenyXu <wenymedia@gmail.com >
* feat: introduce reconcile table procedure
Signed-off-by: WenyXu <wenymedia@gmail.com >
* chore: apply suggestions from CR
Signed-off-by: WenyXu <wenymedia@gmail.com >
* chore: apply suggestions from CR
Signed-off-by: WenyXu <wenymedia@gmail.com >
* chore: apply suggesions from CR
Signed-off-by: WenyXu <wenymedia@gmail.com >
* chore: add tests
Signed-off-by: WenyXu <wenymedia@gmail.com >
* chore: add comments
Signed-off-by: WenyXu <wenymedia@gmail.com >
* chore: update proto
Signed-off-by: WenyXu <wenymedia@gmail.com >
* chore: apply suggestions
Signed-off-by: WenyXu <wenymedia@gmail.com >
---------
Signed-off-by: WenyXu <wenymedia@gmail.com >
* feat: introduce reconcile database procedure (#6612 )
* feat: introduce reconcile database procedure
Signed-off-by: WenyXu <wenymedia@gmail.com >
* feat: hold the schema lock
Signed-off-by: WenyXu <wenymedia@gmail.com >
* chore: add todo
Signed-off-by: WenyXu <wenymedia@gmail.com >
* chore: update comments
Signed-off-by: WenyXu <wenymedia@gmail.com >
* chore: rename to `fast_fail`
Signed-off-by: WenyXu <wenymedia@gmail.com >
* chore: add logs
Signed-off-by: WenyXu <wenymedia@gmail.com >
---------
Signed-off-by: WenyXu <wenymedia@gmail.com >
* feat: introduce reconcile logical tables procedure (#6588 )
* feat: introduce reconcile logical tables procedure
Signed-off-by: WenyXu <wenymedia@gmail.com >
* chore: apply suggestions from CR
Signed-off-by: WenyXu <wenymedia@gmail.com >
* fix: lock logical tables
Signed-off-by: WenyXu <wenymedia@gmail.com >
* chore: apply suggestions from CR
Signed-off-by: WenyXu <wenymedia@gmail.com >
---------
Signed-off-by: WenyXu <wenymedia@gmail.com >
* refactor: remove procedure executor from DDL manager (#6625 )
* refactor: remove procedure executor from DDL manager
Signed-off-by: WenyXu <wenymedia@gmail.com >
* chore: clippy
Signed-off-by: WenyXu <wenymedia@gmail.com >
* chore: apply suggestions from CR
Signed-off-by: WenyXu <wenymedia@gmail.com >
---------
Signed-off-by: WenyXu <wenymedia@gmail.com >
* feat: introduce reconcile catalog procedure (#6613 )
Signed-off-by: WenyXu <wenymedia@gmail.com >
* feat: introduce reconciliation interface (#6614 )
* feat: introduce reconcile interface
Signed-off-by: WenyXu <wenymedia@gmail.com >
* chore: apply suggestions from CR
Signed-off-by: WenyXu <wenymedia@gmail.com >
* chore: apply suggestions from CR
Signed-off-by: WenyXu <wenymedia@gmail.com >
* chore: upgrade proto
Signed-off-by: WenyXu <wenymedia@gmail.com >
---------
Signed-off-by: WenyXu <wenymedia@gmail.com >
* fix: fix sequence peek method to return correct values when sequence is not initialized (#6643 )
fix: improve sequence peek method to handle uninitialized sequences
Signed-off-by: WenyXu <wenymedia@gmail.com >
* fix: sequence peek with remote value (#6648 )
* fix: sequence peek with remote value
* chore: more ut
* chore: add more ut
* feat: add metrics for reconciliation procedures (#6652 )
* feat: add metrics for reconciliation procedures
Signed-off-by: WenyXu <wenymedia@gmail.com >
* refactor: improve error handling
Signed-off-by: WenyXu <wenymedia@gmail.com >
* fix(datanode): handle ignore_nonexistent_region flag in open_all_regions
Signed-off-by: WenyXu <wenymedia@gmail.com >
* chore: apply suggestions from CR
Signed-off-by: WenyXu <wenymedia@gmail.com >
* refactor: merge metrics
Signed-off-by: WenyXu <wenymedia@gmail.com >
* chore: minor refactor
Signed-off-by: WenyXu <wenymedia@gmail.com >
* chore: apply suggestions from CR
Signed-off-by: WenyXu <wenymedia@gmail.com >
---------
Signed-off-by: WenyXu <wenymedia@gmail.com >
* feat(metric-engine): add metadata region cache (#6657 )
* feat(metric-engine): add metadata region cache
Signed-off-by: WenyXu <wenymedia@gmail.com >
* feat: use lru
Signed-off-by: WenyXu <wenymedia@gmail.com >
* chore: rename
Signed-off-by: WenyXu <wenymedia@gmail.com >
* chore: rename
Signed-off-by: WenyXu <wenymedia@gmail.com >
* chore: add comments
Signed-off-by: WenyXu <wenymedia@gmail.com >
* chore: default ttl
Signed-off-by: WenyXu <wenymedia@gmail.com >
* chore: longer ttl
Signed-off-by: WenyXu <wenymedia@gmail.com >
---------
Signed-off-by: WenyXu <wenymedia@gmail.com >
* chore: update greptime-proto
Signed-off-by: WenyXu <wenymedia@gmail.com >
* chore: bump version to 0.15.5
Signed-off-by: WenyXu <wenymedia@gmail.com >
---------
Signed-off-by: WenyXu <wenymedia@gmail.com >
Signed-off-by: evenyag <realevenyag@gmail.com >
Signed-off-by: lyang24 <lanqingy93@gmail.com >
Co-authored-by: Yingwen <realevenyag@gmail.com >
Co-authored-by: Lanqing Yang <lanqingy93@gmail.com >
Co-authored-by: lyang24 <lanqingy@usc.edu >
Co-authored-by: jeremyhi <jiachun_feng@proton.me >
2025-08-07 20:16:48 +08:00
zyy17
a7631239c3
fix: unable to record slow query ( #6590 )
...
* refactor: add process manager for prometheus query
Signed-off-by: zyy17 <zyylsxm@gmail.com >
* refactor: modify `register_query()` API to accept parsed statement(`catalog::process_manager::QueryStatement`)
Signed-off-by: zyy17 <zyylsxm@gmail.com >
* refactor: add the slow query timer in the `Tikcet` of ProcessManager
Signed-off-by: zyy17 <zyylsxm@gmail.com >
* test: add integration tests
Signed-off-by: zyy17 <zyylsxm@gmail.com >
* refactor: add process manager in `do_exec_plan()`
Signed-off-by: zyy17 <zyylsxm@gmail.com >
* tests: add `test_postgres_slow_query` integration test
Signed-off-by: zyy17 <zyylsxm@gmail.com >
* chore: polish the code
Signed-off-by: zyy17 <zyylsxm@gmail.com >
* refactor: create a query ticket and slow query timer if the statement is a query in `query_statement()`
Signed-off-by: zyy17 <zyylsxm@gmail.com >
* fix: sqlness errors
Signed-off-by: zyy17 <zyylsxm@gmail.com >
---------
Signed-off-by: zyy17 <zyylsxm@gmail.com >
2025-08-07 10:15:46 +08:00
evenyag
5fc0c5706c
chore: bump version to v0.15.4
...
Signed-off-by: evenyag <realevenyag@gmail.com >
2025-08-04 22:19:40 +08:00
Ning Sun
4d768b2c31
feat: schema/database support for label_values ( #6631 )
...
* feat: initial support for __schema__ in label values
* feat: filter database with matches
* refactor: skip unnecessary check
* fix: resolve schema matcher in label values
* test: add a test case for table not exists
* refactor: add matchop check on db label
* chore: merge main
Signed-off-by: evenyag <realevenyag@gmail.com >
2025-08-04 22:19:40 +08:00
Yingwen
b62f219810
feat: Add option to limit the files reading simultaneously ( #6635 )
...
* feat: limits the max number of files to scan at the same time
Signed-off-by: evenyag <realevenyag@gmail.com >
* feat: make max_concurrent_scan_files configurable
Signed-off-by: evenyag <realevenyag@gmail.com >
* feat: reduce concurrent scan files to 128
Signed-off-by: evenyag <realevenyag@gmail.com >
* docs: update config example
Signed-off-by: evenyag <realevenyag@gmail.com >
* test: add test for max_concurrent_scan_files
Signed-off-by: evenyag <realevenyag@gmail.com >
* style: fix clippy
Signed-off-by: evenyag <realevenyag@gmail.com >
* test: update config test
Signed-off-by: evenyag <realevenyag@gmail.com >
---------
Signed-off-by: evenyag <realevenyag@gmail.com >
2025-08-04 22:19:40 +08:00
Ruihang Xia
5d330fad17
feat: absent function in PromQL ( #6618 )
...
* feat: absent function in PromQL
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* impl serde
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* sqlness test
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* ai suggests
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* resolve PR comments
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* comment out some tests
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Signed-off-by: evenyag <realevenyag@gmail.com >
2025-08-04 22:19:40 +08:00
Ruihang Xia
dfdfae1a7b
feat: support __schema__ and __database__ in Prom Remote Read ( #6610 )
...
* feat: support __schema__ and __database__ in Prom remote R/W
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix integration test
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* revert remote write changes
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* check matcher type
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Signed-off-by: evenyag <realevenyag@gmail.com >
2025-08-04 22:19:40 +08:00
Ruihang Xia
822f0caf4b
fix: only return the __name__ label when there is one ( #6629 )
...
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Signed-off-by: evenyag <realevenyag@gmail.com >
2025-08-04 22:19:40 +08:00
yihong
09f3d72d2d
fix: closee issue #6555 return empty result ( #6569 )
...
* fix: closee issue #6555 return empty result
Signed-off-by: yihong0618 <zouzou0208@gmail.com >
* fix: only start one instance one regrex sqlness test (#6570 )
Signed-off-by: yihong0618 <zouzou0208@gmail.com >
* refactor: refactor partition mod to use PartitionExpr instead of PartitionDef (#6554 )
* refactor: refactor partition mod to use PartitionExpr instead of PartitionDef
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix snafu
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* Puts expression into PbPartition
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* address comments
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix compile
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* update proto
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* add serde test
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* add serde test
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
---------
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: address comments
Signed-off-by: yihong0618 <zouzou0208@gmail.com >
---------
Signed-off-by: yihong0618 <zouzou0208@gmail.com >
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
Co-authored-by: Zhenchi <zhongzc_arch@outlook.com >
Signed-off-by: evenyag <realevenyag@gmail.com >
2025-07-24 15:00:32 +08:00
Yingwen
ca0c1282ed
chore: bump version to 0.15.3 ( #6580 )
...
Signed-off-by: evenyag <realevenyag@gmail.com >
2025-07-24 11:24:07 +08:00
Yingwen
b719c020ba
chore: cherry pick #6540 , #6550 , #6551 , #6556 , #6563 , #6534 to v0.15 branch ( #6577 )
...
* feat: add metrics for request wait time and adjust stall metrics (#6540 )
* feat: add metric greptime_mito_request_wait_time to observe wait time
Signed-off-by: evenyag <realevenyag@gmail.com >
* feat: add worker to wait time metric
Signed-off-by: evenyag <realevenyag@gmail.com >
* refactor: rename stall gauge to greptime_mito_write_stalling_count
Signed-off-by: evenyag <realevenyag@gmail.com >
* feat: change greptime_mito_write_stall_total to total stalled requests
Signed-off-by: evenyag <realevenyag@gmail.com >
* refactor: merge lazy static blocks
Signed-off-by: evenyag <realevenyag@gmail.com >
---------
Signed-off-by: evenyag <realevenyag@gmail.com >
* fix: estimate mem size for bulk ingester (#6550 )
Signed-off-by: evenyag <realevenyag@gmail.com >
* fix: flow mirror cache (#6551 )
* fix: invalid cache when flownode change address
Signed-off-by: discord9 <discord9@163.com >
* update comments
Signed-off-by: discord9 <discord9@163.com >
* fix
Signed-off-by: discord9 <discord9@163.com >
* refactor: add log&rename
Signed-off-by: discord9 <discord9@163.com >
* stuff
Signed-off-by: discord9 <discord9@163.com >
---------
Signed-off-by: discord9 <discord9@163.com >
Signed-off-by: evenyag <realevenyag@gmail.com >
* feat: impl timestamp function for promql (#6556 )
* feat: impl timestamp function for promql
Signed-off-by: Dennis Zhuang <killme2008@gmail.com >
* chore: style and typo
Signed-off-by: Dennis Zhuang <killme2008@gmail.com >
* fix: test
Signed-off-by: Dennis Zhuang <killme2008@gmail.com >
* docs: update comments
Signed-off-by: Dennis Zhuang <killme2008@gmail.com >
* chore: comment
Signed-off-by: Dennis Zhuang <killme2008@gmail.com >
---------
Signed-off-by: Dennis Zhuang <killme2008@gmail.com >
Signed-off-by: evenyag <realevenyag@gmail.com >
* feat: MergeScan print input (#6563 )
* feat: MergeScan print input
Signed-off-by: discord9 <discord9@163.com >
* test: fix ut
Signed-off-by: discord9 <discord9@163.com >
---------
Signed-off-by: discord9 <discord9@163.com >
Signed-off-by: evenyag <realevenyag@gmail.com >
* fix: aggr group by all partition cols use partial commutative (#6534 )
* fix: aggr group by all partition cols use partial commutative
Signed-off-by: discord9 <discord9@163.com >
* test: bugged case
Signed-off-by: discord9 <discord9@163.com >
* test: sqlness fix
Signed-off-by: discord9 <discord9@163.com >
* test: more redacted
Signed-off-by: discord9 <discord9@163.com >
* more cases
Signed-off-by: discord9 <discord9@163.com >
* even more test cases
Signed-off-by: discord9 <discord9@163.com >
* join testcase
Signed-off-by: discord9 <discord9@163.com >
* fix: column requirement added in correct location
Signed-off-by: discord9 <discord9@163.com >
* fix test
Signed-off-by: discord9 <discord9@163.com >
* chore: clippy
Signed-off-by: discord9 <discord9@163.com >
* track col reqs per stack
Signed-off-by: discord9 <discord9@163.com >
* fix: continue
Signed-off-by: discord9 <discord9@163.com >
* chore: clippy
Signed-off-by: discord9 <discord9@163.com >
* refactor: test mod
Signed-off-by: discord9 <discord9@163.com >
* test utils
Signed-off-by: discord9 <discord9@163.com >
* test: better test
Signed-off-by: discord9 <discord9@163.com >
* more testcases
Signed-off-by: discord9 <discord9@163.com >
* test limit push down
Signed-off-by: discord9 <discord9@163.com >
* more testcases
Signed-off-by: discord9 <discord9@163.com >
* more testcase
Signed-off-by: discord9 <discord9@163.com >
* more test
Signed-off-by: discord9 <discord9@163.com >
* chore: update sqlness
Signed-off-by: discord9 <discord9@163.com >
* chore: update commnets
Signed-off-by: discord9 <discord9@163.com >
* fix: check col reqs from bottom to upper
Signed-off-by: discord9 <discord9@163.com >
* chore: more comment
Signed-off-by: discord9 <discord9@163.com >
* docs: more todo
Signed-off-by: discord9 <discord9@163.com >
* chore: comments
Signed-off-by: discord9 <discord9@163.com >
* test: a new failing test that should be fixed
Signed-off-by: discord9 <discord9@163.com >
* fix: part col alias tracking
Signed-off-by: discord9 <discord9@163.com >
* chore: unused
Signed-off-by: discord9 <discord9@163.com >
* chore: clippy
Signed-off-by: discord9 <discord9@163.com >
* docs: comment
Signed-off-by: discord9 <discord9@163.com >
* mroe testcase
Signed-off-by: discord9 <discord9@163.com >
* more testcase for step/part aggr combine
Signed-off-by: discord9 <discord9@163.com >
* FIXME: a new bug
Signed-off-by: discord9 <discord9@163.com >
* literally unfixable
Signed-off-by: discord9 <discord9@163.com >
* chore: remove some debug print
Signed-off-by: discord9 <discord9@163.com >
---------
Signed-off-by: discord9 <discord9@163.com >
Signed-off-by: evenyag <realevenyag@gmail.com >
---------
Signed-off-by: evenyag <realevenyag@gmail.com >
Signed-off-by: discord9 <discord9@163.com >
Signed-off-by: Dennis Zhuang <killme2008@gmail.com >
Co-authored-by: fys <40801205+fengys1996@users.noreply.github.com >
Co-authored-by: discord9 <55937128+discord9@users.noreply.github.com >
Co-authored-by: dennis zhuang <killme2008@gmail.com >
2025-07-23 22:29:14 +08:00
Ruihang Xia
717c1d1807
feat: update partial execution metrics ( #6499 )
...
* feat: update partial execution metrics
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* send data with metrics in distributed mode
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix clippy
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* only send partial metrics under VERBOSE flag
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* loop to while
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Signed-off-by: evenyag <realevenyag@gmail.com >
2025-07-23 20:54:33 +08:00
Zhenchi
291f3c89fe
fix: row selection intersection removes trailing rows ( #6539 )
...
* fix: row selection intersection removes trailing rows
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix typos
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
---------
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
Signed-off-by: evenyag <realevenyag@gmail.com >
2025-07-23 20:54:33 +08:00
discord9
602cc38056
fix: breaking loop when not retryable ( #6538 )
...
fix: breaking when not retryable
Signed-off-by: discord9 <discord9@163.com >
Signed-off-by: evenyag <realevenyag@gmail.com >
2025-07-23 20:54:33 +08:00
Lei, HUANG
46b3593021
fix(grpc): check grpc client unavailable ( #6488 )
...
* fix/check-grpc-client-unavailable:
Improve async handling in `greptime_handler.rs`
- Updated the `DoPut` response handling to use `await` with `result_sender.send` for better asynchronous operation.
Signed-off-by: Lei, HUANG <mrsatangel@gmail.com >
* fix/check-grpc-client-unavailable:
### Improve Error Handling in `greptime_handler.rs`
- Enhanced error handling for the `DoPut` operation by switching from `send` to `try_send` for the `result_sender`.
- Added specific logging for unreachable clients, including `request_id` in the warning message.
Signed-off-by: Lei, HUANG <mrsatangel@gmail.com >
---------
Signed-off-by: Lei, HUANG <mrsatangel@gmail.com >
Signed-off-by: evenyag <realevenyag@gmail.com >
2025-07-23 20:54:33 +08:00
Yan Tingwang
ff402fd6f6
test: add sqlness test for max execution time ( #6517 )
...
* add sqlness test for max_execution_time
Signed-off-by: codephage. <tingwangyan2020@163.com >
* add Pre-line comments SQLNESS PROTOCOL MYSQL
Signed-off-by: codephage. <tingwangyan2020@163.com >
* fix(mysql): support max_execution_time variable
Co-authored-by: evenyag <realevenyag@gmail.com >
Signed-off-by: codephage. <tingwangyan2020@163.com >
* fix: test::test_check & sqlness test mysql
Signed-off-by: codephage. <tingwangyan2020@163.com >
* add sqlness test for max_execution_time
Signed-off-by: codephage. <tingwangyan2020@163.com >
* add Pre-line comments SQLNESS PROTOCOL MYSQL
Signed-off-by: codephage. <tingwangyan2020@163.com >
* fix(mysql): support max_execution_time variable
Co-authored-by: evenyag <realevenyag@gmail.com >
Signed-off-by: codephage. <tingwangyan2020@163.com >
* fix: test::test_check & sqlness test mysql
Signed-off-by: codephage. <tingwangyan2020@163.com >
* chore: Unify the sql style
Signed-off-by: codephage. <tingwangyan2020@163.com >
---------
Signed-off-by: codephage. <tingwangyan2020@163.com >
Co-authored-by: evenyag <realevenyag@gmail.com >
Signed-off-by: evenyag <realevenyag@gmail.com >
2025-07-23 20:54:33 +08:00
Yan Tingwang
b83e6e2b18
fix: add system variable max_execution_time ( #6511 )
...
add system variable : max_execution_time
Signed-off-by: codephage. <tingwangyan2020@163.com >
Signed-off-by: evenyag <realevenyag@gmail.com >
2025-07-23 20:54:33 +08:00
discord9
cb74337dbe
refactor(flow): faster time window expr ( #6495 )
...
* refactor: faster window expr
Signed-off-by: discord9 <discord9@163.com >
* docs: explain fast path
Signed-off-by: discord9 <discord9@163.com >
* chore: rm unwrap
Signed-off-by: discord9 <discord9@163.com >
---------
Signed-off-by: discord9 <discord9@163.com >
Signed-off-by: evenyag <realevenyag@gmail.com >
2025-07-23 20:54:33 +08:00
shuiyisong
32bffbb668
feat: add filter processor to v0.15 ( #6516 )
...
feat: add filter processor
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
2025-07-14 17:43:49 +08:00
evenyag
941906dc74
chore: bump version to v0.15.2
...
Signed-off-by: evenyag <realevenyag@gmail.com >
2025-07-11 00:24:21 +08:00
Ruihang Xia
cbf251d0f0
fix: expand on conditional commutative as well ( #6484 )
...
* fix: expand on conditional commutative as well
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Signed-off-by: discord9 <discord9@163.com >
* update sqlness result
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Signed-off-by: discord9 <discord9@163.com >
* add logging to figure test failure
Signed-off-by: discord9 <discord9@163.com >
* revert
Signed-off-by: discord9 <discord9@163.com >
* feat: stream drop record metrics
Signed-off-by: discord9 <discord9@163.com >
* Revert "feat: stream drop record metrics"
This reverts commit 6a16946a5b8ea37557bbb1b600847d24274d6500.
Signed-off-by: discord9 <discord9@163.com >
* feat: stream drop record metrics
Signed-off-by: discord9 <discord9@163.com >
refactor: move logging to drop too
Signed-off-by: discord9 <discord9@163.com >
fix: drop input stream before collect metrics
Signed-off-by: discord9 <discord9@163.com >
* fix: expand differently
Signed-off-by: discord9 <discord9@163.com >
* test: update sqlness
Signed-off-by: discord9 <discord9@163.com >
* chore: more dbg
Signed-off-by: discord9 <discord9@163.com >
* Revert "feat: stream drop record metrics"
This reverts commit 3eda4a2257928d95cf9c1328ae44fae84cfbb017.
Signed-off-by: discord9 <discord9@163.com >
* test: sqlness redacted
Signed-off-by: discord9 <discord9@163.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Signed-off-by: discord9 <discord9@163.com >
Co-authored-by: discord9 <discord9@163.com >
Signed-off-by: evenyag <realevenyag@gmail.com >
2025-07-11 00:24:21 +08:00
shuiyisong
1519379262
chore: skip calc ts in doc 2 with transform ( #6509 )
...
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
Signed-off-by: evenyag <realevenyag@gmail.com >
2025-07-10 22:40:07 +08:00
localhost
4bfe02ec7f
chore: remove region id to reduce time series ( #6506 )
...
Signed-off-by: evenyag <realevenyag@gmail.com >
2025-07-10 22:40:07 +08:00
Weny Xu
ecacf1333e
fix: correctly update partition key indices during alter table operations ( #6494 )
...
* fix: correctly update partition key indices in alter table operations
Signed-off-by: WenyXu <wenymedia@gmail.com >
* test: add sqlness tests
Signed-off-by: WenyXu <wenymedia@gmail.com >
---------
Signed-off-by: WenyXu <wenymedia@gmail.com >
Signed-off-by: evenyag <realevenyag@gmail.com >
2025-07-10 22:40:07 +08:00
Yingwen
92fa33c250
fix: range query returns range selector error when table not found ( #6481 )
...
* test: add sqlness test for range vector with non-existence metric
Signed-off-by: evenyag <realevenyag@gmail.com >
* fix: handle empty metric for matrix selector
Signed-off-by: evenyag <realevenyag@gmail.com >
* test: update sqlness result
Signed-off-by: evenyag <realevenyag@gmail.com >
* chore: add newline
Signed-off-by: evenyag <realevenyag@gmail.com >
---------
Signed-off-by: evenyag <realevenyag@gmail.com >
2025-07-10 22:40:07 +08:00
shuiyisong
8b2d1a3753
fix: skip nan in prom remote write pipeline ( #6489 )
...
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
Signed-off-by: evenyag <realevenyag@gmail.com >
2025-07-10 22:40:07 +08:00
Ning Sun
13401c94e0
feat: allow alternative version string ( #6472 )
...
* feat: allow alternative version string
* refactor: rename original version function to verbose_version
Signed-off-by: Ning Sun <sunning@greptime.com >
---------
Signed-off-by: Ning Sun <sunning@greptime.com >
Signed-off-by: evenyag <realevenyag@gmail.com >
2025-07-10 22:40:07 +08:00
shuiyisong
fd637dae47
chore: sort range query return values ( #6474 )
...
* chore: sort range query return values
* chore: add comments
* chore: add is_sorted check
* fix: test
Signed-off-by: evenyag <realevenyag@gmail.com >
2025-07-10 22:40:07 +08:00
dennis zhuang
69fac19770
fix: empty statements hang ( #6480 )
...
* fix: empty statements hang
Signed-off-by: Dennis Zhuang <killme2008@gmail.com >
* tests: add cases
Signed-off-by: Dennis Zhuang <killme2008@gmail.com >
---------
Signed-off-by: Dennis Zhuang <killme2008@gmail.com >
Signed-off-by: evenyag <realevenyag@gmail.com >
2025-07-10 22:40:07 +08:00
discord9
6435b97314
fix: stricter win sort condition ( #6477 )
...
test: sqlness
test: fix sqlness redacted
Signed-off-by: discord9 <discord9@163.com >
Signed-off-by: evenyag <realevenyag@gmail.com >
2025-07-10 22:40:07 +08:00
Weny Xu
726e3909fe
fix(metric-engine): handle stale metadata region recovery failures ( #6395 )
...
* fix(metric-engine): handle stale metadata region recovery failures
Signed-off-by: WenyXu <wenymedia@gmail.com >
* test: add unit tests
Signed-off-by: WenyXu <wenymedia@gmail.com >
---------
Signed-off-by: WenyXu <wenymedia@gmail.com >
Signed-off-by: evenyag <realevenyag@gmail.com >
2025-07-10 22:40:07 +08:00
evenyag
00d759e828
chore: bump version to v0.15.1
...
Signed-off-by: evenyag <realevenyag@gmail.com >
2025-07-04 22:53:46 +08:00
Lei, HUANG
0042ea6462
fix: filter empty batch in bulk insert api ( #6459 )
...
* fix/filter-empty-batch-in-bulk-insert-api:
**Add Early Return for Empty Record Batches in `bulk_insert.rs`**
- Implemented an early return in the `Inserter` implementation to handle cases where `record_batch.num_rows()` is zero, improving efficiency by avoiding unnecessary processing.
Signed-off-by: Lei, HUANG <mrsatangel@gmail.com >
* fix/filter-empty-batch-in-bulk-insert-api:
**Improve Bulk Insert Handling**
- **`handle_bulk_insert.rs`**: Added a check to handle cases where the batch has zero rows, immediately returning and sending a success response with zero rows processed.
- **`bulk_insert.rs`**: Enhanced logic to skip processing for masks that select none, optimizing the bulk insert operation by avoiding unnecessary iterations.
These changes improve the efficiency and robustness of the bulk insert process by handling edge cases more effectively.
Signed-off-by: Lei, HUANG <mrsatangel@gmail.com >
* fix/filter-empty-batch-in-bulk-insert-api:
### Refactor and Error Handling Enhancements
- **Refactored Timestamp Handling**: Introduced `timestamp_array_to_primitive` function in `timestamp.rs` to streamline conversion of timestamp arrays to primitive arrays, reducing redundancy in `handle_bulk_insert.rs` and `bulk_insert.rs`.
- **Error Handling**: Added `InconsistentTimestampLength` error in `error.rs` to handle mismatched timestamp column lengths in bulk insert operations.
- **Bulk Insert Logic**: Updated `handle_bulk_insert.rs` to utilize the new timestamp conversion function and added checks for timestamp length consistency.
Signed-off-by: Lei, HUANG <mrsatangel@gmail.com >
* fix/filter-empty-batch-in-bulk-insert-api:
**Refactor `bulk_insert.rs` to streamline imports**
- Simplified import statements by removing unused timestamp-related arrays and data types from the `arrow` crate in `bulk_insert.rs`.
Signed-off-by: Lei, HUANG <mrsatangel@gmail.com >
---------
Signed-off-by: Lei, HUANG <mrsatangel@gmail.com >
Signed-off-by: evenyag <realevenyag@gmail.com >
2025-07-04 22:53:46 +08:00
Zhenchi
d06450715f
fix: add backward compatibility for SkippingIndexOptions deserialization ( #6458 )
...
* fix: add backward compatibility for `SkippingIndexOptions` deserialization
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* address comments
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* address comments
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
---------
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
Signed-off-by: evenyag <realevenyag@gmail.com >
2025-07-04 22:53:46 +08:00
evenyag
8612bb066f
chore: fix statement compile errors
...
Signed-off-by: evenyag <realevenyag@gmail.com >
2025-07-03 23:05:21 +08:00
Yingwen
467593d329
fix: enable max_execution time for other read only statements ( #6454 )
...
Also disable the timeout when timeout is 0
Signed-off-by: evenyag <realevenyag@gmail.com >
2025-07-03 23:05:21 +08:00
Ruihang Xia
9e4ae070b2
feat: skip rule checker on ingestion ( #6453 )
...
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2025-07-03 23:05:21 +08:00
Ruihang Xia
d8261dda51
feat!: point matrix based partition rule checker ( #6431 )
...
* bare implementation
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* stateful generator
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* error report
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix remap checkpoint
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* use matrix generator as iterator
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* pre-calculate suffix product
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update existing test cases
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix clippy
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* sqlness
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix ut
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* clean up
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Signed-off-by: evenyag <realevenyag@gmail.com >
2025-07-03 23:05:21 +08:00
dennis zhuang
7ab9b335a1
fix: label_replace and label_join functions when used as sub‐expressions ( #6443 )
...
* fix: label_replace and label_join functions in expressions
Signed-off-by: Dennis Zhuang <killme2008@gmail.com >
* chore: remove update_fields
Signed-off-by: Dennis Zhuang <killme2008@gmail.com >
* chore: tql eval -> TQL EVAL
Signed-off-by: Dennis Zhuang <killme2008@gmail.com >
* fix: empty regex and not existing source label
Signed-off-by: Dennis Zhuang <killme2008@gmail.com >
* chore: simplfy test
Signed-off-by: Dennis Zhuang <killme2008@gmail.com >
* fix: test
Signed-off-by: Dennis Zhuang <killme2008@gmail.com >
* fix: test
Signed-off-by: Dennis Zhuang <killme2008@gmail.com >
---------
Signed-off-by: Dennis Zhuang <killme2008@gmail.com >
Signed-off-by: evenyag <realevenyag@gmail.com >
2025-07-03 23:05:21 +08:00
Ruihang Xia
60835afb47
feat: Collider for playing with PartitionRule ( #6399 )
...
* skeleton
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* initial impl and tests
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* refactor and reorganize
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix clippy
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix typo
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add comment
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* error handling
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* explain naming
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Signed-off-by: evenyag <realevenyag@gmail.com >
2025-07-03 23:05:21 +08:00
fys
aba5bf7431
refactor: avoid adding feature to parameter ( #6391 )
...
* refactor: avoid adding feature to parameter
* avoid `cfg(not(feature = ...))` block
2025-07-03 15:48:22 +08:00
Yingwen
7897fe8dbe
fix: correct MAX_EXECUTION_TIME timeout calculation ( #6444 )
...
* feat: implement statement timeout in frontend instance
Signed-off-by: evenyag <realevenyag@gmail.com >
* fix: fail fast when timeout is 0
Signed-off-by: evenyag <realevenyag@gmail.com >
* fix: update start time
Signed-off-by: evenyag <realevenyag@gmail.com >
---------
Signed-off-by: evenyag <realevenyag@gmail.com >
2025-07-03 10:46:35 +08:00
Ruihang Xia
cc8ec706a1
fix: remap column indices on overriding logical table partitions ( #6446 )
...
* fix: remap column indices on overriding logical table partitions
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* sqlness
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* refactor map query
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Signed-off-by: evenyag <realevenyag@gmail.com >
2025-07-03 10:46:35 +08:00
Weny Xu
7c688718db
fix: fix dest_keys chunks bug in TombstoneManager ( #6432 )
...
* fix(meta): fix dest_keys_chunks bug in TombstoneManager
Signed-off-by: WenyXu <wenymedia@gmail.com >
* chore: fix typo
Signed-off-by: WenyXu <wenymedia@gmail.com >
* fix: fix sqlness tests
Signed-off-by: WenyXu <wenymedia@gmail.com >
---------
Signed-off-by: WenyXu <wenymedia@gmail.com >
Signed-off-by: evenyag <realevenyag@gmail.com >
2025-07-03 10:46:35 +08:00
shuiyisong
8a0e554e5a
feat(pipeline): support Loki API ( #6390 )
...
* chore: use schema_info
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* refactor: abstract loki item generator
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* chore: introduce middle item
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* feat: introduce pipeline in loki api
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* test: add tests
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* chore: minor update
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* chore: minor update
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* chore: update prefix and test
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* chore: change recursion to loop
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* fix: cr issue
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
---------
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
Signed-off-by: evenyag <realevenyag@gmail.com >
2025-07-03 10:46:35 +08:00
jeremyhi
80fae1c559
feat: override logical table's partition key indices ( #6385 )
...
* feat: Override logical table's partition key indices with physical table's
* chore: by comment
Signed-off-by: evenyag <realevenyag@gmail.com >
2025-07-03 10:46:35 +08:00
Zhenchi
c37c4df20d
feat: pick #6416 to release/0.15 ( #6445 )
...
* feat: pick #6416 to release/0.15
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* upgrade proto
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
---------
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
2025-07-02 08:55:54 +00:00
