rust/greptimedb
1
0
Fork 0
mirror of https://github.com/GreptimeTeam/greptimedb.git synced 2026-07-06 14:00:40 +00:00
Code Issues Packages Projects Releases Wiki Activity
5,489 Commits 143 Branches 261 Tags
0bfbfacd3ea2ca74a21d5390f2964eb18d0c2b65
Commit Graph

5489 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
copilot-swe-agent[bot]
0bfbfacd3e Revert setup action files to main state 2026-05-26 18:12:25 +00:00
copilot-swe-agent[bot]
4f9ff49aaf Revert nonessential setup action edits 2026-05-26 18:06:37 +00:00
copilot-swe-agent[bot]
f90709b11f Align postgres docker setup with dependency pulls 2026-05-26 18:01:19 +00:00
copilot-swe-agent[bot]
9f9a4d2361 Decouple sqlness docker setup from cluster actions 2026-05-26 18:00:26 +00:00
copilot-swe-agent[bot]
3ca136c192 Update sqlness workflow setup steps 2026-05-26 18:00:07 +00:00
copilot-swe-agent[bot]
b8295f8a48 Clarify MySQL setup action usage 2026-05-26 17:50:13 +00:00
copilot-swe-agent[bot]
33189c54c5 Describe reusable sqlness setup actions 2026-05-26 17:49:16 +00:00
copilot-swe-agent[bot]
8b7acc9fb0 Refactor sqlness CI to reuse setup actions 2026-05-26 17:47:52 +00:00
copilot-swe-agent[bot]
90deb44907 Normalize sqlness MySQL job name 2026-05-26 17:40:01 +00:00
copilot-swe-agent[bot]
6aa522cc68 Clarify sqlness kafka readiness wait 2026-05-26 17:39:46 +00:00
copilot-swe-agent[bot]
180e566a76 Migrate sqlness CI dependencies to services 2026-05-26 17:38:45 +00:00
Weny Xu
f513b77ccc feat: support alter table partition syntax (#8177) 
* feat(sql): support alter table partition syntax

Signed-off-by: WenyXu <wenymedia@gmail.com>

* feat: support repartition source proto

Signed-off-by: WenyXu <wenymedia@gmail.com>

* chore: update greptime-proto

Signed-off-by: WenyXu <wenymedia@gmail.com>

---------

Signed-off-by: WenyXu <wenymedia@gmail.com>
 2026-05-26 15:06:14 +00:00
Weny Xu
5943b41067 refactor: split repartition region descriptors (#8172) 
* refactor: split repartition region descriptors

Signed-off-by: WenyXu <wenymedia@gmail.com>

* feat(meta-srv): support default source repartition planning

Signed-off-by: WenyXu <wenymedia@gmail.com>

* feat(meta-srv): support default source repartition metadata

Signed-off-by: WenyXu <wenymedia@gmail.com>

* chore: apply suggestions

Signed-off-by: WenyXu <wenymedia@gmail.com>

* chore: apply suggestions

Signed-off-by: WenyXu <wenymedia@gmail.com>

---------

Signed-off-by: WenyXu <wenymedia@gmail.com>
 2026-05-26 12:54:54 +00:00
Weny Xu
0675cffe68 refactor: use structured pusher key (#8155) 
Signed-off-by: WenyXu <wenymedia@gmail.com>
 2026-05-26 08:53:34 +00:00
Yingwen
a23ff4d589 perf(mito): split record batches on equal timestamps (#8163) 
* perf(mito): split record batches on equal timestamps

Signed-off-by: evenyag <realevenyag@gmail.com>

* test(mito): cover equal-timestamp runs at batch boundaries

Signed-off-by: evenyag <realevenyag@gmail.com>

---------

Signed-off-by: evenyag <realevenyag@gmail.com>
 2026-05-26 08:19:52 +00:00
discord9
44f1804b5e feat: add flow query-context plumbing for terminal watermarks (#8154) 
* feat: add flow checkpoint plumbing

Signed-off-by: discord9 <discord9@163.com>

* fix: restore when fail

Signed-off-by: discord9 <discord9@163.com>

* refactor: per review

Signed-off-by: discord9 <discord9@163.com>

* refactor: per review

Signed-off-by: discord9 <discord9@163.com>

* chore: clean up some test

Signed-off-by: discord9 <discord9@163.com>

* clippy

Signed-off-by: discord9 <discord9@163.com>

* refactor: move more to pr3b

Signed-off-by: discord9 <discord9@163.com>

* refactor: per review

Signed-off-by: discord9 <discord9@163.com>

---------

Signed-off-by: discord9 <discord9@163.com>
 2026-05-26 07:24:18 +00:00
Yingwen
6193e8760b feat: initial implementation for range cache with time filters (#8130) 
* feat: initial implementation for range cache time filters

Signed-off-by: evenyag <realevenyag@gmail.com>

* refactor: tighten Lt implied time range bound

Signed-off-by: evenyag <realevenyag@gmail.com>

* docs: tighten range cache key comment

Signed-off-by: evenyag <realevenyag@gmail.com>

* fix: skip range cache unit asserts on empty implied range

Signed-off-by: evenyag <realevenyag@gmail.com>

---------

Signed-off-by: evenyag <realevenyag@gmail.com>
 2026-05-26 07:03:31 +00:00
jeremyhi
c84462bdc1 feat(cli): add export-v2 delete command (#8162) 
* feat(cli): add export-v2 celete command

Signed-off-by: jeremyhi <fengjiachun@gmail.com>

* fix: by AI comments

Signed-off-by: jeremyhi <fengjiachun@gmail.com>

* feat(cli): refine delete confirmation flag

Signed-off-by: jeremyhi <fengjiachun@gmail.com>

---------

Signed-off-by: jeremyhi <fengjiachun@gmail.com>
 2026-05-26 04:28:23 +00:00
Rogier Lommers
fd53ebc8a3 fix: update RPC bind address in README (#8168) 2026-05-25 13:50:45 +00:00
fys
8d3ebde652 fix(mito2): schema-safe skipping index pruning (#8122) 
* fix: schema-safe skipping index pruning

* fix: cargo clippy

* fix: sqlness test

* remove default plan in BloomFilterIndexApplier

* fix comment of plan_for_sst

* add fast path for default_plan

* minor refactor

* some rename

* fix: cr by ai
 2026-05-25 11:45:42 +00:00
yihong
eb264d9adf fix: faster jieba (#8158) 
* fix: faster jieba

Signed-off-by: yihong0618 <zouzou0208@gmail.com>

* fix: also update tantivy and the api

Signed-off-by: yihong0618 <zouzou0208@gmail.com>

* fix: better bench follow the copilot review

Signed-off-by: yihong0618 <zouzou0208@gmail.com>

* fix: apply comments

Signed-off-by: yihong0618 <zouzou0208@gmail.com>

---------

Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2026-05-25 08:51:40 +00:00
Yingwen
a25152664b fix: qualify HistogramFold schema (#8157) 
* test: add regression test for binary op on histogram_quantile (#8144)

Signed-off-by: evenyag <realevenyag@gmail.com>

* fix: preserve column qualifiers in HistogramFold output schema (#8144)

Signed-off-by: evenyag <realevenyag@gmail.com>

---------

Signed-off-by: evenyag <realevenyag@gmail.com>
 2026-05-25 07:40:48 +00:00
Weny Xu
8f7951c5bd fix: close heartbeat streams on metasrv leader stepdown (#8156) 
* fix: reregister missing heartbeat pusher

Signed-off-by: WenyXu <wenymedia@gmail.com>

* refactor: extract heartbeat session

Signed-off-by: WenyXu <wenymedia@gmail.com>

* test: cover heartbeat session

Signed-off-by: WenyXu <wenymedia@gmail.com>

* chore: apply suggestions

Signed-off-by: WenyXu <wenymedia@gmail.com>

---------

Signed-off-by: WenyXu <wenymedia@gmail.com>
 2026-05-25 07:40:03 +00:00
Ning Sun
5401cc2e26 feat: update some interceptor to carry more information (#8090) 
* feat: provide query information for post_execute interceptor

* test: update for tests-integration

* feat: make interceptor available to prometheus serialization

* feat: revert post_execute change

* feat: add expr to pre_execute and remove serialization interceptor

* chore: lint
 2026-05-25 03:14:15 +00:00
Yingwen
e1e75b3ffe feat: implement a cache for the prefilter (#8102) 
* feat: cache parquet prefilter results

Signed-off-by: evenyag <realevenyag@gmail.com>

* chore: set result cache size

Signed-off-by: evenyag <realevenyag@gmail.com>

* refactor: rename is_stable to is_immutable and reject ScalarVariable

Signed-off-by: evenyag <realevenyag@gmail.com>

* chore: typo

Signed-off-by: evenyag <realevenyag@gmail.com>

* refactor: use capacity() for prefilter key memory accounting

Signed-off-by: evenyag <realevenyag@gmail.com>

* feat: per filter cache

Signed-off-by: evenyag <realevenyag@gmail.com>

* refactor: support other variants in MaybeFilter

Signed-off-by: evenyag <realevenyag@gmail.com>

* refactor: split compute_projection_mask

Signed-off-by: evenyag <realevenyag@gmail.com>

* refactor: build_prefilter_masks takes PrefilterEntry

Signed-off-by: evenyag <realevenyag@gmail.com>

---------

Signed-off-by: evenyag <realevenyag@gmail.com>
 2026-05-25 03:10:12 +00:00
discord9
8c267f3844 fix(mysql): keep unknown prepare placeholders (#8150) 
* fix(mysql): keep unknown prepare placeholders

Signed-off-by: discord9 <discord9@163.com>

* fix(mysql): use span-based placeholder fallback

Signed-off-by: discord9 <discord9@163.com>

* fix(mysql): visit placeholders in all statements

Signed-off-by: discord9 <discord9@163.com>

* refactor(mysql): remove placeholder transform wrapper

Signed-off-by: discord9 <discord9@163.com>

---------

Signed-off-by: discord9 <discord9@163.com>
v1.1.0-nightly-20260525 		2026-05-24 06:18:22 +00:00
QuakeWang
9916027ca2 test: verify KILL cancels INSERT SELECT (#8151) 
* test: verify kill cancels insert select

Signed-off-by: QuakeWang <wangfuzheng0814@foxmail.com>

* test: propagate insert select kill test errors

Signed-off-by: QuakeWang <wangfuzheng0814@foxmail.com>

---------

Signed-off-by: QuakeWang <wangfuzheng0814@foxmail.com>
 2026-05-23 15:50:07 +00:00
Weny Xu
1cd6b30058 fix: reject physical metric table writes (#8153) 
Signed-off-by: WenyXu <wenymedia@gmail.com>
 2026-05-22 11:57:43 +00:00
discord9
f1ad472075 fix(mysql): infer LIMIT placeholders in prepare (#8149) 
Signed-off-by: discord9 <discord9@163.com>
 2026-05-21 23:40:10 +00:00
LFC
4668dd43bd feat: merge files to add in one region edit (#8141) 
Signed-off-by: luofucong <luofc@foxmail.com>
 2026-05-21 10:55:10 +00:00
Weny Xu
13fe5bc8a3 fix: skip sst cache preload for staging manifest (#8147) 
Signed-off-by: WenyXu <wenymedia@gmail.com>
 2026-05-21 08:55:17 +00:00
Weny Xu
15fc148e40 refactor: clarify region flush reasons (#8146) 
* refactor: clarify region flush reasons

Signed-off-by: WenyXu <wenymedia@gmail.com>

* chore: apply suggestions from CR

Signed-off-by: WenyXu <wenymedia@gmail.com>

---------

Signed-off-by: WenyXu <wenymedia@gmail.com>
 2026-05-21 07:35:46 +00:00
QuakeWang
ba679dddfa fix: track INSERT SELECT in process manager (#8138) 
* fix: track insert select in process list

Signed-off-by: QuakeWang <wangfuzheng0814@foxmail.com>

* fix: avoid generic process tracking future

Signed-off-by: QuakeWang <wangfuzheng0814@foxmail.com>

---------

Signed-off-by: QuakeWang <wangfuzheng0814@foxmail.com>
 2026-05-21 07:16:22 +00:00
LFC
59b738d7f2 feat: compact json2 data (#8103) 
Signed-off-by: luofucong <luofc@foxmail.com>
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
 2026-05-21 07:14:32 +00:00
discord9
454344ab4d feat: inc query join rewrite helper (#8108) 
* feat: inc query join rewrite helper

Signed-off-by: discord9 <discord9@163.com>

* chore: rm unwrap

Signed-off-by: discord9 <discord9@163.com>

* refactor: per review

Signed-off-by: discord9 <discord9@163.com>

* chore

Signed-off-by: discord9 <discord9@163.com>

* per review

Signed-off-by: discord9 <discord9@163.com>

* refactor: per review

Signed-off-by: discord9 <discord9@163.com>

* refactor: pre review

Signed-off-by: discord9 <discord9@163.com>

* more per review

Signed-off-by: discord9 <discord9@163.com>

* test: add expected plan test

Signed-off-by: discord9 <discord9@163.com>

* fix: disallow having

Signed-off-by: discord9 <discord9@163.com>

* refactor: allow list

Signed-off-by: discord9 <discord9@163.com>

* fix: also reject groupings

Signed-off-by: discord9 <discord9@163.com>

* fix: rm global aggr

Signed-off-by: discord9 <discord9@163.com>

* refactor: split test

Signed-off-by: discord9 <discord9@163.com>

* fix: computed shadow expr

Signed-off-by: discord9 <discord9@163.com>

---------

Signed-off-by: discord9 <discord9@163.com>
 2026-05-21 07:04:57 +00:00
Ruihang Xia
ab3cadb4b5 feat: use and cache page index from sst meta (#8139) 
* feat: cache sst meta with policy aware

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

* load page index when necessary

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

---------

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>
 2026-05-21 06:06:44 +00:00
Lei, HUANG
1e987e66c8 fix: skip flush when closing follower region (#8143) 
* fix/flush-on-close: Guard close flush by region state

- `close flush`: skip pending-data flush for non-flushable regions in `src/mito2/src/worker/handle_close.rs`
- `flushable region`: surface `FlushableRegionState` errors from `RegionMap::flushable_region` in `src/mito2/src/error.rs`, `src/mito2/src/region.rs`, and `src/mito2/src/worker/handle_flush.rs`

Signed-off-by: Lei, HUANG <mrsatangel@gmail.com>

* fix/flush-on-close: Cover follower close with pending data

- `regression test`: cover closing a Noop WAL follower region with pending memtable data in `src/mito2/src/engine/skip_wal_test.rs`

Signed-off-by: Lei, HUANG <mrsatangel@gmail.com>

* fix: comments and logs

Signed-off-by: Lei, HUANG <mrsatangel@gmail.com>

---------

Signed-off-by: Lei, HUANG <mrsatangel@gmail.com>
 2026-05-21 03:51:14 +00:00
shuiyisong
28bed396e2 chore: introduce user cache invalidation api (#8129) 
* chore: introduce user cache invalidation api

Signed-off-by: shuiyisong <xixing.sys@gmail.com>

* chore: update using plugins hook

Signed-off-by: shuiyisong <xixing.sys@gmail.com>

---------

Signed-off-by: shuiyisong <xixing.sys@gmail.com>
 2026-05-20 13:41:09 +00:00
Lei, HUANG
12a4e934f1 feat(meta-srv): add selector factory plugin hook (#8140) 
* meta-srv: introduce SelectorWrapper to wrap configured selector

- `SelectorWrapper trait`: add `SelectorWrapper` trait and `SelectorWrapperRef` in `src/meta-srv/src/metasrv.rs` to support decorating selectors
- `metasrv bootstrap`: apply `SelectorWrapperRef` in `src/meta-srv/src/bootstrap.rs` to wrap the configured selector, and add unit tests to verify the behavior

Signed-off-by: Lei, HUANG <mrsatangel@gmail.com>

* feat(meta-srv): add selector factory plugin hook

- `SelectorFactory`: replace selector wrapper registration with a bootstrap-time factory context in `src/meta-srv/src/metasrv.rs`
- `metasrv_builder`: build the configured base selector before invoking plugin factories in `src/meta-srv/src/bootstrap.rs`

Signed-off-by: Lei, HUANG <mrsatangel@gmail.com>

---------

Signed-off-by: Lei, HUANG <mrsatangel@gmail.com>
 2026-05-20 12:53:40 +00:00
LFC
a6dc55a71c feat: show sst primary key range in information_schema (#8137) 
Signed-off-by: luofucong <luofc@foxmail.com>
 2026-05-20 12:50:18 +00:00
Weny Xu
2f1ca88f30 refactor: use node info for active discovery (#8121) 
* refactor: use node info for active discovery

Signed-off-by: WenyXu <wenymedia@gmail.com>

* chore: clippy

Signed-off-by: WenyXu <wenymedia@gmail.com>

* fix: fix unit tests

Signed-off-by: WenyXu <wenymedia@gmail.com>

---------

Signed-off-by: WenyXu <wenymedia@gmail.com>
 2026-05-20 07:31:01 +00:00
Lei, HUANG
f8df016623 feat: add InfluxDB default merge mode config (#8134) 
* feat/influxdb-default-merge-mode: add InfluxDB merge mode config

- `influxdb` config: add `default_merge_mode` parsing and defaults in `src/frontend/src/service_config/influxdb.rs` and `src/frontend/src/service_config.rs`
- auto-create behavior: apply configured `merge_mode` for InfluxDB ingestion in `src/frontend/src/instance.rs`, `src/frontend/src/instance/builder.rs`, `src/frontend/src/instance/influxdb.rs`, and `src/operator/src/insert.rs`
- config docs: document `influxdb.default_merge_mode` in `config/frontend.example.toml`, `config/standalone.example.toml`, and `config/config.md`

Signed-off-by: Lei, HUANG <mrsatangel@gmail.com>

* feat/influxdb-default-merge-mode: derive merge mode default

- `influxdb` config: derive `Default` for `InfluxdbMergeMode` in `src/frontend/src/service_config/influxdb.rs`

Signed-off-by: Lei, HUANG <mrsatangel@gmail.com>

* feat/influxdb-default-merge-mode: update config API snapshot

- `config API`: include `default_merge_mode` in `tests-integration/tests/http.rs`

Signed-off-by: Lei, HUANG <mrsatangel@gmail.com>

* feat/influxdb-default-merge-mode: avoid default context clone

- `InfluxDB merge mode`: avoid cloning `QueryContext` for default `last_non_null` in `src/frontend/src/instance/influxdb.rs`
- `InfluxDB merge mode`: cover default, configured, and explicit `MERGE_MODE_KEY` paths in `src/frontend/src/instance/influxdb.rs`

Signed-off-by: Lei, HUANG <mrsatangel@gmail.com>

---------

Signed-off-by: Lei, HUANG <mrsatangel@gmail.com>
 2026-05-19 16:54:36 +00:00
fys
418318da51 fix: flaky sqlness result ordering (#8136) 
* fix: flaky sqlness result ordering

* fix: flaky sqlness result
 2026-05-19 16:29:21 +00:00
LFC
6f0c04ad82 chore: pub some functions (#8133) 
Signed-off-by: luofucong <luofc@foxmail.com>
 2026-05-19 10:00:40 +00:00
jeremyhi
72434ee5d7 feat: add export-v2 snapshot verification (#8111) 
* feat: add export-v2 snapshot verification

Signed-off-by: jeremyhi <fengjiachun@gmail.com>

* fix: by AI comments

Signed-off-by: jeremyhi <fengjiachun@gmail.com>

* fix: by comments

Signed-off-by: jeremyhi <fengjiachun@gmail.com>

* fix: by AI comments

Signed-off-by: jeremyhi <fengjiachun@gmail.com>

* fix: reject full export snapshots without chunks

Signed-off-by: jeremyhi <fengjiachun@gmail.com>

* fix: by AI comments

Signed-off-by: jeremyhi <fengjiachun@gmail.com>

* fix: by AI comments

Signed-off-by: jeremyhi <fengjiachun@gmail.com>

* fix: by AI comments

Signed-off-by: jeremyhi <fengjiachun@gmail.com>

* fix: enforce strict export snapshot data mainifest

Signed-off-by: jeremyhi <fengjiachun@gmail.com>

---------

Signed-off-by: jeremyhi <fengjiachun@gmail.com>
 2026-05-19 07:15:51 +00:00
Yingwen
b97f630adb chore: bump version to v1.1.0 (#8131) 
Signed-off-by: evenyag <realevenyag@gmail.com>
 2026-05-19 07:15:44 +00:00
Lei, HUANG
0a2400cbb9 fix: optimize sorted run picking (#8128) 
* fix/optimize-pick: Optimize sorted run picking

- `find_sorted_runs`: prune inactive run candidates and keep `find_sorted_runs_original` for testing in `src/mito2/src/compaction/run.rs`
- `bench_compaction_picker`: compare old and new sorted-run picking with PK-aware workloads in `src/mito2/benches/bench_compaction_picker.rs`
- `features`: expose `testing` for benchmark-only helpers in `src/mito2/Cargo.toml`

Signed-off-by: Lei, HUANG <mrsatangel@gmail.com>

* fix/optimize-pick: Remove redundant overlap guard

- `find_sorted_runs`: simplify active candidate overlap checks in `src/mito2/src/compaction/run.rs`

Signed-off-by: Lei, HUANG <mrsatangel@gmail.com>

* fix: apply review comment

Signed-off-by: Lei, HUANG <mrsatangel@gmail.com>

---------

Signed-off-by: Lei, HUANG <mrsatangel@gmail.com>
 2026-05-19 05:16:11 +00:00
shuiyisong
d4cfbd3400 feat: add otlp to prometheus naming translation options (#8113) 
* chore: extract otlp translator

Signed-off-by: shuiyisong <xixing.sys@gmail.com>

* feat: add header parsing

Signed-off-by: shuiyisong <xixing.sys@gmail.com>

* chore: add tests

Signed-off-by: shuiyisong <xixing.sys@gmail.com>

* chore: add tests

Signed-off-by: shuiyisong <xixing.sys@gmail.com>

* chore: simplify and merge tests

Signed-off-by: shuiyisong <xixing.sys@gmail.com>

---------

Signed-off-by: shuiyisong <xixing.sys@gmail.com>
v1.0.0-nightly-20260518 		2026-05-16 04:52:45 +00:00
shuiyisong
fafa677012 chore: use opendal main branch (#8118) 
* chore: use opendal main branch

Signed-off-by: shuiyisong <xixing.sys@gmail.com>

* fix: fmt

Signed-off-by: shuiyisong <xixing.sys@gmail.com>

---------

Signed-off-by: shuiyisong <xixing.sys@gmail.com>
 2026-05-15 23:01:50 +00:00
Ruihang Xia
3cbd15c1a9 refactor: remove async file reader adapter layer (#8120) 
Signed-off-by: Ruihang Xia <waynestxia@gmail.com>
 2026-05-15 12:58:31 +00:00