rust/greptimedb
1
0
Fork 0
mirror of https://github.com/GreptimeTeam/greptimedb.git synced 2026-05-31 12:20:38 +00:00
Code Issues Packages Projects Releases Wiki Activity
5,488 Commits 139 Branches 254 Tags
1a2d0463514a6c9b9527c74a4b896cdbc1b4b60d
Commit Graph

5488 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Weny Xu
1a2d046351 fix(mito): count owned SSTs in region stats (#8191) 
* fix(mito): count owned SSTs in region stats

Signed-off-by: WenyXu <wenymedia@gmail.com>

* fix(mito): use origin region for index metadata

Signed-off-by: WenyXu <wenymedia@gmail.com>

* chore: apply suggestions

Signed-off-by: WenyXu <wenymedia@gmail.com>

* chore: apply suggestions

Signed-off-by: WenyXu <wenymedia@gmail.com>

---------

Signed-off-by: WenyXu <wenymedia@gmail.com>
 2026-05-28 10:04:39 +00:00
Lei, HUANG
9a4e5e8457 chore: expose region info inspection table (#8178) 
* chore/region-sync-diff: add region info inspection core

- `store-api`: add `RegionInfoEntry` schema and plan builder in `src/store-api/src/region_info.rs` and export it from `src/store-api/src/lib.rs`
- `mito2`: collect region runtime metadata with `MitoEngine::all_region_infos` and `RegionRoleState::as_str` in `src/mito2/src/engine.rs`, `src/mito2/src/region.rs`, `src/mito2/src/engine/basic_test.rs`, `src/mito2/Cargo.toml`, and `Cargo.lock`
- `datanode`: expose the reserved `InspectRegionInfo` provider in `src/datanode/src/region_server/catalog.rs`

Signed-off-by: Lei, HUANG <mrsatangel@gmail.com>

* chore/region-sync-diff: expose region info schema table

- `information_schema.region_info`: add frontend table wiring in `src/catalog/src/system_schema/information_schema.rs`, `src/catalog/src/system_schema/information_schema/region_info.rs`, `src/catalog/src/system_schema/information_schema/table_names.rs`, and `src/common/catalog/src/consts.rs`
- `region_group` removal: drop `region_group` from `src/store-api/src/region_info.rs`, `src/mito2/src/region.rs`, and `src/mito2/src/engine/basic_test.rs`
- `SQLness coverage`: add standalone coverage in `tests/cases/standalone/common/information_schema/region_info.sql` and `tests/cases/standalone/common/information_schema/region_info.result`

Signed-off-by: Lei, HUANG <mrsatangel@gmail.com>

* chore/region-sync-diff: restore region group info

- `region_info` schema: restore `region_group` alongside `region_sequence` in `src/store-api/src/region_info.rs`, `src/mito2/src/region.rs`, `src/mito2/src/engine/basic_test.rs`, and `tests/cases/standalone/common/information_schema/region_info.result`
- `MitoEngine::all_region_infos`: remove redundant iterator conversion in `src/mito2/src/engine.rs`

Signed-off-by: Lei, HUANG <mrsatangel@gmail.com>

* fix: sqlness

Signed-off-by: Lei, HUANG <mrsatangel@gmail.com>

* fix: sqlness

Signed-off-by: Lei, HUANG <mrsatangel@gmail.com>

* chore/region-sync-diff: clarify region sequence columns

- `region_info` schema: rename `sequence` to `committed_sequence` and add nullable `flushed_sequence` in `src/store-api/src/region_info.rs` and `src/mito2/src/region.rs`
- `region_info` coverage: update sequence assertions and expected metadata in `src/mito2/src/engine/basic_test.rs`, `tests/cases/standalone/common/information_schema/region_info.sql`, `tests/cases/standalone/common/information_schema/region_info.result`, and `tests/cases/standalone/common/system/information_schema.result`

Signed-off-by: Lei, HUANG <mrsatangel@gmail.com>

* chore/region-sync-diff: report region options errors

- `region_info` output: preserve `region_options` serialization failures as JSON error objects in `src/mito2/src/region.rs`

Signed-off-by: Lei, HUANG <mrsatangel@gmail.com>

---------

Signed-off-by: Lei, HUANG <mrsatangel@gmail.com>
 2026-05-28 09:52:37 +00:00
discord9
eccd97b5c7 feat(flow): support incremental read checkpoints (#8179) 
* feat: flownode inc mode

Signed-off-by: discord9 <discord9@163.com>

* chore: rename fallback reason

Signed-off-by: discord9 <discord9@163.com>

* fix: harden flow incremental checkpoints

Signed-off-by: discord9 <discord9@163.com>

* fix: address flow watermark lint

Signed-off-by: discord9 <discord9@163.com>

* fix: address flow clippy

Signed-off-by: discord9 <discord9@163.com>

* refactor: clarify incremental plan preparation

Signed-off-by: discord9 <discord9@163.com>

* refactor: per review

Signed-off-by: discord9 <discord9@163.com>

* refactor: per review

Signed-off-by: discord9 <discord9@163.com>

* test: more sqlness test

Signed-off-by: discord9 <discord9@163.com>

* refactor: per review

Signed-off-by: discord9 <discord9@163.com>

---------

Signed-off-by: discord9 <discord9@163.com>
 2026-05-28 09:31:46 +00:00
shuiyisong
17815830ed chore: add LeaderServicesContext control to standalone (#8164) 
* chore: add refresh hook

Signed-off-by: shuiyisong <xixing.sys@gmail.com>

* chore: merge start_with_context and start

Signed-off-by: shuiyisong <xixing.sys@gmail.com>

* chore: place reset in recover

Signed-off-by: shuiyisong <xixing.sys@gmail.com>

* chore: revert stop changes

Signed-off-by: shuiyisong <xixing.sys@gmail.com>

* fix: CR issue

Signed-off-by: shuiyisong <xixing.sys@gmail.com>

---------

Signed-off-by: shuiyisong <xixing.sys@gmail.com>
 2026-05-28 09:23:30 +00:00
Weny Xu
123524474d fix: reset procedure manager state on stop (#8174) 
* fix: reset procedure manager state on stop

Signed-off-by: WenyXu <wenymedia@gmail.com>

* chore: apply suggestions from CR

Signed-off-by: WenyXu <wenymedia@gmail.com>

* chore: apply suggestions

Signed-off-by: WenyXu <wenymedia@gmail.com>

* fix: fix unit tests

Signed-off-by: WenyXu <wenymedia@gmail.com>

* chore: apply suggestions

Signed-off-by: WenyXu <wenymedia@gmail.com>

---------

Signed-off-by: WenyXu <wenymedia@gmail.com>
 2026-05-28 03:45:04 +00:00
Weny Xu
91ac84019b feat(meta-srv): support repartition for unpartitioned tables (#8186) 
* feat(meta-srv): update repartition partition metadata

Signed-off-by: WenyXu <wenymedia@gmail.com>

* feat(meta-srv): connect repartition source metadata

Signed-off-by: WenyXu <wenymedia@gmail.com>

* test(meta-srv): cover unpartitioned repartition rollback

Signed-off-by: WenyXu <wenymedia@gmail.com>

* chore: apply suggestions

Signed-off-by: WenyXu <wenymedia@gmail.com>

* feat: connect unpartitioned repartition SQL path

Signed-off-by: WenyXu <wenymedia@gmail.com>

* chore: apply suggestions

Signed-off-by: WenyXu <wenymedia@gmail.com>

---------

Signed-off-by: WenyXu <wenymedia@gmail.com>
 2026-05-28 03:31:55 +00:00
LFC
bf7e3551fe test: add jsonbench tests (#8165) 
Signed-off-by: luofucong <luofc@foxmail.com>
 2026-05-27 08:34:06 +00:00
Yingwen
9487e2c3ca fix: divide series for subquery output (#8173) 
* fix: divide series for subquery output

Signed-off-by: evenyag <realevenyag@gmail.com>

* fix: propagate time index lookup error in prom_call_manipulate

Signed-off-by: evenyag <realevenyag@gmail.com>

---------

Signed-off-by: evenyag <realevenyag@gmail.com>
 2026-05-27 07:10:24 +00:00
Copilot
67887d3ec6 ci: add PostgreSQL and MySQL dependency setup steps to sqlness job (#8185) 
* Migrate sqlness CI dependencies to services

* Clarify sqlness kafka readiness wait

* Normalize sqlness MySQL job name

* Refactor sqlness CI to reuse setup actions

* Describe reusable sqlness setup actions

* Clarify MySQL setup action usage

* Update sqlness workflow setup steps

* Decouple sqlness docker setup from cluster actions

* Align postgres docker setup with dependency pulls

* Revert nonessential setup action edits

* Revert setup action files to main state

---------

Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
 2026-05-27 04:36:42 +00:00
dennis zhuang
407d048136 feat: update project status and architecture (#8182) 
* feat: update readme

Signed-off-by: Dennis Zhuang <killme2008@gmail.com>

* fix: image link

Signed-off-by: Dennis Zhuang <killme2008@gmail.com>

* chore: style

Signed-off-by: Dennis Zhuang <killme2008@gmail.com>

* feat: adds agent onboarding

Signed-off-by: Dennis Zhuang <killme2008@gmail.com>

* fix: address by CR

Signed-off-by: Dennis Zhuang <killme2008@gmail.com>

* fix: link

Signed-off-by: Dennis Zhuang <killme2008@gmail.com>

---------

Signed-off-by: Dennis Zhuang <killme2008@gmail.com>
 2026-05-27 00:20:47 +00:00
Weny Xu
f513b77ccc feat: support alter table partition syntax (#8177) 
* feat(sql): support alter table partition syntax

Signed-off-by: WenyXu <wenymedia@gmail.com>

* feat: support repartition source proto

Signed-off-by: WenyXu <wenymedia@gmail.com>

* chore: update greptime-proto

Signed-off-by: WenyXu <wenymedia@gmail.com>

---------

Signed-off-by: WenyXu <wenymedia@gmail.com>
 2026-05-26 15:06:14 +00:00
Weny Xu
5943b41067 refactor: split repartition region descriptors (#8172) 
* refactor: split repartition region descriptors

Signed-off-by: WenyXu <wenymedia@gmail.com>

* feat(meta-srv): support default source repartition planning

Signed-off-by: WenyXu <wenymedia@gmail.com>

* feat(meta-srv): support default source repartition metadata

Signed-off-by: WenyXu <wenymedia@gmail.com>

* chore: apply suggestions

Signed-off-by: WenyXu <wenymedia@gmail.com>

* chore: apply suggestions

Signed-off-by: WenyXu <wenymedia@gmail.com>

---------

Signed-off-by: WenyXu <wenymedia@gmail.com>
 2026-05-26 12:54:54 +00:00
Weny Xu
0675cffe68 refactor: use structured pusher key (#8155) 
Signed-off-by: WenyXu <wenymedia@gmail.com>
 2026-05-26 08:53:34 +00:00
Yingwen
a23ff4d589 perf(mito): split record batches on equal timestamps (#8163) 
* perf(mito): split record batches on equal timestamps

Signed-off-by: evenyag <realevenyag@gmail.com>

* test(mito): cover equal-timestamp runs at batch boundaries

Signed-off-by: evenyag <realevenyag@gmail.com>

---------

Signed-off-by: evenyag <realevenyag@gmail.com>
 2026-05-26 08:19:52 +00:00
discord9
44f1804b5e feat: add flow query-context plumbing for terminal watermarks (#8154) 
* feat: add flow checkpoint plumbing

Signed-off-by: discord9 <discord9@163.com>

* fix: restore when fail

Signed-off-by: discord9 <discord9@163.com>

* refactor: per review

Signed-off-by: discord9 <discord9@163.com>

* refactor: per review

Signed-off-by: discord9 <discord9@163.com>

* chore: clean up some test

Signed-off-by: discord9 <discord9@163.com>

* clippy

Signed-off-by: discord9 <discord9@163.com>

* refactor: move more to pr3b

Signed-off-by: discord9 <discord9@163.com>

* refactor: per review

Signed-off-by: discord9 <discord9@163.com>

---------

Signed-off-by: discord9 <discord9@163.com>
 2026-05-26 07:24:18 +00:00
Yingwen
6193e8760b feat: initial implementation for range cache with time filters (#8130) 
* feat: initial implementation for range cache time filters

Signed-off-by: evenyag <realevenyag@gmail.com>

* refactor: tighten Lt implied time range bound

Signed-off-by: evenyag <realevenyag@gmail.com>

* docs: tighten range cache key comment

Signed-off-by: evenyag <realevenyag@gmail.com>

* fix: skip range cache unit asserts on empty implied range

Signed-off-by: evenyag <realevenyag@gmail.com>

---------

Signed-off-by: evenyag <realevenyag@gmail.com>
 2026-05-26 07:03:31 +00:00
jeremyhi
c84462bdc1 feat(cli): add export-v2 delete command (#8162) 
* feat(cli): add export-v2 celete command

Signed-off-by: jeremyhi <fengjiachun@gmail.com>

* fix: by AI comments

Signed-off-by: jeremyhi <fengjiachun@gmail.com>

* feat(cli): refine delete confirmation flag

Signed-off-by: jeremyhi <fengjiachun@gmail.com>

---------

Signed-off-by: jeremyhi <fengjiachun@gmail.com>
 2026-05-26 04:28:23 +00:00
Rogier Lommers
fd53ebc8a3 fix: update RPC bind address in README (#8168) 2026-05-25 13:50:45 +00:00
fys
8d3ebde652 fix(mito2): schema-safe skipping index pruning (#8122) 
* fix: schema-safe skipping index pruning

* fix: cargo clippy

* fix: sqlness test

* remove default plan in BloomFilterIndexApplier

* fix comment of plan_for_sst

* add fast path for default_plan

* minor refactor

* some rename

* fix: cr by ai
 2026-05-25 11:45:42 +00:00
yihong
eb264d9adf fix: faster jieba (#8158) 
* fix: faster jieba

Signed-off-by: yihong0618 <zouzou0208@gmail.com>

* fix: also update tantivy and the api

Signed-off-by: yihong0618 <zouzou0208@gmail.com>

* fix: better bench follow the copilot review

Signed-off-by: yihong0618 <zouzou0208@gmail.com>

* fix: apply comments

Signed-off-by: yihong0618 <zouzou0208@gmail.com>

---------

Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2026-05-25 08:51:40 +00:00
Yingwen
a25152664b fix: qualify HistogramFold schema (#8157) 
* test: add regression test for binary op on histogram_quantile (#8144)

Signed-off-by: evenyag <realevenyag@gmail.com>

* fix: preserve column qualifiers in HistogramFold output schema (#8144)

Signed-off-by: evenyag <realevenyag@gmail.com>

---------

Signed-off-by: evenyag <realevenyag@gmail.com>
 2026-05-25 07:40:48 +00:00
Weny Xu
8f7951c5bd fix: close heartbeat streams on metasrv leader stepdown (#8156) 
* fix: reregister missing heartbeat pusher

Signed-off-by: WenyXu <wenymedia@gmail.com>

* refactor: extract heartbeat session

Signed-off-by: WenyXu <wenymedia@gmail.com>

* test: cover heartbeat session

Signed-off-by: WenyXu <wenymedia@gmail.com>

* chore: apply suggestions

Signed-off-by: WenyXu <wenymedia@gmail.com>

---------

Signed-off-by: WenyXu <wenymedia@gmail.com>
 2026-05-25 07:40:03 +00:00
Ning Sun
5401cc2e26 feat: update some interceptor to carry more information (#8090) 
* feat: provide query information for post_execute interceptor

* test: update for tests-integration

* feat: make interceptor available to prometheus serialization

* feat: revert post_execute change

* feat: add expr to pre_execute and remove serialization interceptor

* chore: lint
 2026-05-25 03:14:15 +00:00
Yingwen
e1e75b3ffe feat: implement a cache for the prefilter (#8102) 
* feat: cache parquet prefilter results

Signed-off-by: evenyag <realevenyag@gmail.com>

* chore: set result cache size

Signed-off-by: evenyag <realevenyag@gmail.com>

* refactor: rename is_stable to is_immutable and reject ScalarVariable

Signed-off-by: evenyag <realevenyag@gmail.com>

* chore: typo

Signed-off-by: evenyag <realevenyag@gmail.com>

* refactor: use capacity() for prefilter key memory accounting

Signed-off-by: evenyag <realevenyag@gmail.com>

* feat: per filter cache

Signed-off-by: evenyag <realevenyag@gmail.com>

* refactor: support other variants in MaybeFilter

Signed-off-by: evenyag <realevenyag@gmail.com>

* refactor: split compute_projection_mask

Signed-off-by: evenyag <realevenyag@gmail.com>

* refactor: build_prefilter_masks takes PrefilterEntry

Signed-off-by: evenyag <realevenyag@gmail.com>

---------

Signed-off-by: evenyag <realevenyag@gmail.com>
 2026-05-25 03:10:12 +00:00
discord9
8c267f3844 fix(mysql): keep unknown prepare placeholders (#8150) 
* fix(mysql): keep unknown prepare placeholders

Signed-off-by: discord9 <discord9@163.com>

* fix(mysql): use span-based placeholder fallback

Signed-off-by: discord9 <discord9@163.com>

* fix(mysql): visit placeholders in all statements

Signed-off-by: discord9 <discord9@163.com>

* refactor(mysql): remove placeholder transform wrapper

Signed-off-by: discord9 <discord9@163.com>

---------

Signed-off-by: discord9 <discord9@163.com>
v1.1.0-nightly-20260525 		2026-05-24 06:18:22 +00:00
QuakeWang
9916027ca2 test: verify KILL cancels INSERT SELECT (#8151) 
* test: verify kill cancels insert select

Signed-off-by: QuakeWang <wangfuzheng0814@foxmail.com>

* test: propagate insert select kill test errors

Signed-off-by: QuakeWang <wangfuzheng0814@foxmail.com>

---------

Signed-off-by: QuakeWang <wangfuzheng0814@foxmail.com>
 2026-05-23 15:50:07 +00:00
Weny Xu
1cd6b30058 fix: reject physical metric table writes (#8153) 
Signed-off-by: WenyXu <wenymedia@gmail.com>
 2026-05-22 11:57:43 +00:00
discord9
f1ad472075 fix(mysql): infer LIMIT placeholders in prepare (#8149) 
Signed-off-by: discord9 <discord9@163.com>
 2026-05-21 23:40:10 +00:00
LFC
4668dd43bd feat: merge files to add in one region edit (#8141) 
Signed-off-by: luofucong <luofc@foxmail.com>
 2026-05-21 10:55:10 +00:00
Weny Xu
13fe5bc8a3 fix: skip sst cache preload for staging manifest (#8147) 
Signed-off-by: WenyXu <wenymedia@gmail.com>
 2026-05-21 08:55:17 +00:00
Weny Xu
15fc148e40 refactor: clarify region flush reasons (#8146) 
* refactor: clarify region flush reasons

Signed-off-by: WenyXu <wenymedia@gmail.com>

* chore: apply suggestions from CR

Signed-off-by: WenyXu <wenymedia@gmail.com>

---------

Signed-off-by: WenyXu <wenymedia@gmail.com>
 2026-05-21 07:35:46 +00:00
QuakeWang
ba679dddfa fix: track INSERT SELECT in process manager (#8138) 
* fix: track insert select in process list

Signed-off-by: QuakeWang <wangfuzheng0814@foxmail.com>

* fix: avoid generic process tracking future

Signed-off-by: QuakeWang <wangfuzheng0814@foxmail.com>

---------

Signed-off-by: QuakeWang <wangfuzheng0814@foxmail.com>
 2026-05-21 07:16:22 +00:00
LFC
59b738d7f2 feat: compact json2 data (#8103) 
Signed-off-by: luofucong <luofc@foxmail.com>
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
 2026-05-21 07:14:32 +00:00
discord9
454344ab4d feat: inc query join rewrite helper (#8108) 
* feat: inc query join rewrite helper

Signed-off-by: discord9 <discord9@163.com>

* chore: rm unwrap

Signed-off-by: discord9 <discord9@163.com>

* refactor: per review

Signed-off-by: discord9 <discord9@163.com>

* chore

Signed-off-by: discord9 <discord9@163.com>

* per review

Signed-off-by: discord9 <discord9@163.com>

* refactor: per review

Signed-off-by: discord9 <discord9@163.com>

* refactor: pre review

Signed-off-by: discord9 <discord9@163.com>

* more per review

Signed-off-by: discord9 <discord9@163.com>

* test: add expected plan test

Signed-off-by: discord9 <discord9@163.com>

* fix: disallow having

Signed-off-by: discord9 <discord9@163.com>

* refactor: allow list

Signed-off-by: discord9 <discord9@163.com>

* fix: also reject groupings

Signed-off-by: discord9 <discord9@163.com>

* fix: rm global aggr

Signed-off-by: discord9 <discord9@163.com>

* refactor: split test

Signed-off-by: discord9 <discord9@163.com>

* fix: computed shadow expr

Signed-off-by: discord9 <discord9@163.com>

---------

Signed-off-by: discord9 <discord9@163.com>
 2026-05-21 07:04:57 +00:00
Ruihang Xia
ab3cadb4b5 feat: use and cache page index from sst meta (#8139) 
* feat: cache sst meta with policy aware

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

* load page index when necessary

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

---------

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>
 2026-05-21 06:06:44 +00:00
Lei, HUANG
1e987e66c8 fix: skip flush when closing follower region (#8143) 
* fix/flush-on-close: Guard close flush by region state

- `close flush`: skip pending-data flush for non-flushable regions in `src/mito2/src/worker/handle_close.rs`
- `flushable region`: surface `FlushableRegionState` errors from `RegionMap::flushable_region` in `src/mito2/src/error.rs`, `src/mito2/src/region.rs`, and `src/mito2/src/worker/handle_flush.rs`

Signed-off-by: Lei, HUANG <mrsatangel@gmail.com>

* fix/flush-on-close: Cover follower close with pending data

- `regression test`: cover closing a Noop WAL follower region with pending memtable data in `src/mito2/src/engine/skip_wal_test.rs`

Signed-off-by: Lei, HUANG <mrsatangel@gmail.com>

* fix: comments and logs

Signed-off-by: Lei, HUANG <mrsatangel@gmail.com>

---------

Signed-off-by: Lei, HUANG <mrsatangel@gmail.com>
 2026-05-21 03:51:14 +00:00
shuiyisong
28bed396e2 chore: introduce user cache invalidation api (#8129) 
* chore: introduce user cache invalidation api

Signed-off-by: shuiyisong <xixing.sys@gmail.com>

* chore: update using plugins hook

Signed-off-by: shuiyisong <xixing.sys@gmail.com>

---------

Signed-off-by: shuiyisong <xixing.sys@gmail.com>
 2026-05-20 13:41:09 +00:00
Lei, HUANG
12a4e934f1 feat(meta-srv): add selector factory plugin hook (#8140) 
* meta-srv: introduce SelectorWrapper to wrap configured selector

- `SelectorWrapper trait`: add `SelectorWrapper` trait and `SelectorWrapperRef` in `src/meta-srv/src/metasrv.rs` to support decorating selectors
- `metasrv bootstrap`: apply `SelectorWrapperRef` in `src/meta-srv/src/bootstrap.rs` to wrap the configured selector, and add unit tests to verify the behavior

Signed-off-by: Lei, HUANG <mrsatangel@gmail.com>

* feat(meta-srv): add selector factory plugin hook

- `SelectorFactory`: replace selector wrapper registration with a bootstrap-time factory context in `src/meta-srv/src/metasrv.rs`
- `metasrv_builder`: build the configured base selector before invoking plugin factories in `src/meta-srv/src/bootstrap.rs`

Signed-off-by: Lei, HUANG <mrsatangel@gmail.com>

---------

Signed-off-by: Lei, HUANG <mrsatangel@gmail.com>
 2026-05-20 12:53:40 +00:00
LFC
a6dc55a71c feat: show sst primary key range in information_schema (#8137) 
Signed-off-by: luofucong <luofc@foxmail.com>
 2026-05-20 12:50:18 +00:00
Weny Xu
2f1ca88f30 refactor: use node info for active discovery (#8121) 
* refactor: use node info for active discovery

Signed-off-by: WenyXu <wenymedia@gmail.com>

* chore: clippy

Signed-off-by: WenyXu <wenymedia@gmail.com>

* fix: fix unit tests

Signed-off-by: WenyXu <wenymedia@gmail.com>

---------

Signed-off-by: WenyXu <wenymedia@gmail.com>
 2026-05-20 07:31:01 +00:00
Lei, HUANG
f8df016623 feat: add InfluxDB default merge mode config (#8134) 
* feat/influxdb-default-merge-mode: add InfluxDB merge mode config

- `influxdb` config: add `default_merge_mode` parsing and defaults in `src/frontend/src/service_config/influxdb.rs` and `src/frontend/src/service_config.rs`
- auto-create behavior: apply configured `merge_mode` for InfluxDB ingestion in `src/frontend/src/instance.rs`, `src/frontend/src/instance/builder.rs`, `src/frontend/src/instance/influxdb.rs`, and `src/operator/src/insert.rs`
- config docs: document `influxdb.default_merge_mode` in `config/frontend.example.toml`, `config/standalone.example.toml`, and `config/config.md`

Signed-off-by: Lei, HUANG <mrsatangel@gmail.com>

* feat/influxdb-default-merge-mode: derive merge mode default

- `influxdb` config: derive `Default` for `InfluxdbMergeMode` in `src/frontend/src/service_config/influxdb.rs`

Signed-off-by: Lei, HUANG <mrsatangel@gmail.com>

* feat/influxdb-default-merge-mode: update config API snapshot

- `config API`: include `default_merge_mode` in `tests-integration/tests/http.rs`

Signed-off-by: Lei, HUANG <mrsatangel@gmail.com>

* feat/influxdb-default-merge-mode: avoid default context clone

- `InfluxDB merge mode`: avoid cloning `QueryContext` for default `last_non_null` in `src/frontend/src/instance/influxdb.rs`
- `InfluxDB merge mode`: cover default, configured, and explicit `MERGE_MODE_KEY` paths in `src/frontend/src/instance/influxdb.rs`

Signed-off-by: Lei, HUANG <mrsatangel@gmail.com>

---------

Signed-off-by: Lei, HUANG <mrsatangel@gmail.com>
 2026-05-19 16:54:36 +00:00
fys
418318da51 fix: flaky sqlness result ordering (#8136) 
* fix: flaky sqlness result ordering

* fix: flaky sqlness result
 2026-05-19 16:29:21 +00:00
LFC
6f0c04ad82 chore: pub some functions (#8133) 
Signed-off-by: luofucong <luofc@foxmail.com>
 2026-05-19 10:00:40 +00:00
jeremyhi
72434ee5d7 feat: add export-v2 snapshot verification (#8111) 
* feat: add export-v2 snapshot verification

Signed-off-by: jeremyhi <fengjiachun@gmail.com>

* fix: by AI comments

Signed-off-by: jeremyhi <fengjiachun@gmail.com>

* fix: by comments

Signed-off-by: jeremyhi <fengjiachun@gmail.com>

* fix: by AI comments

Signed-off-by: jeremyhi <fengjiachun@gmail.com>

* fix: reject full export snapshots without chunks

Signed-off-by: jeremyhi <fengjiachun@gmail.com>

* fix: by AI comments

Signed-off-by: jeremyhi <fengjiachun@gmail.com>

* fix: by AI comments

Signed-off-by: jeremyhi <fengjiachun@gmail.com>

* fix: by AI comments

Signed-off-by: jeremyhi <fengjiachun@gmail.com>

* fix: enforce strict export snapshot data mainifest

Signed-off-by: jeremyhi <fengjiachun@gmail.com>

---------

Signed-off-by: jeremyhi <fengjiachun@gmail.com>
 2026-05-19 07:15:51 +00:00
Yingwen
b97f630adb chore: bump version to v1.1.0 (#8131) 
Signed-off-by: evenyag <realevenyag@gmail.com>
 2026-05-19 07:15:44 +00:00
Lei, HUANG
0a2400cbb9 fix: optimize sorted run picking (#8128) 
* fix/optimize-pick: Optimize sorted run picking

- `find_sorted_runs`: prune inactive run candidates and keep `find_sorted_runs_original` for testing in `src/mito2/src/compaction/run.rs`
- `bench_compaction_picker`: compare old and new sorted-run picking with PK-aware workloads in `src/mito2/benches/bench_compaction_picker.rs`
- `features`: expose `testing` for benchmark-only helpers in `src/mito2/Cargo.toml`

Signed-off-by: Lei, HUANG <mrsatangel@gmail.com>

* fix/optimize-pick: Remove redundant overlap guard

- `find_sorted_runs`: simplify active candidate overlap checks in `src/mito2/src/compaction/run.rs`

Signed-off-by: Lei, HUANG <mrsatangel@gmail.com>

* fix: apply review comment

Signed-off-by: Lei, HUANG <mrsatangel@gmail.com>

---------

Signed-off-by: Lei, HUANG <mrsatangel@gmail.com>
 2026-05-19 05:16:11 +00:00
shuiyisong
d4cfbd3400 feat: add otlp to prometheus naming translation options (#8113) 
* chore: extract otlp translator

Signed-off-by: shuiyisong <xixing.sys@gmail.com>

* feat: add header parsing

Signed-off-by: shuiyisong <xixing.sys@gmail.com>

* chore: add tests

Signed-off-by: shuiyisong <xixing.sys@gmail.com>

* chore: add tests

Signed-off-by: shuiyisong <xixing.sys@gmail.com>

* chore: simplify and merge tests

Signed-off-by: shuiyisong <xixing.sys@gmail.com>

---------

Signed-off-by: shuiyisong <xixing.sys@gmail.com>
v1.0.0-nightly-20260518 		2026-05-16 04:52:45 +00:00
shuiyisong
fafa677012 chore: use opendal main branch (#8118) 
* chore: use opendal main branch

Signed-off-by: shuiyisong <xixing.sys@gmail.com>

* fix: fmt

Signed-off-by: shuiyisong <xixing.sys@gmail.com>

---------

Signed-off-by: shuiyisong <xixing.sys@gmail.com>
 2026-05-15 23:01:50 +00:00
Ruihang Xia
3cbd15c1a9 refactor: remove async file reader adapter layer (#8120) 
Signed-off-by: Ruihang Xia <waynestxia@gmail.com>
 2026-05-15 12:58:31 +00:00
Yingwen
7840aa1bb4 refactor(mito2)!: remove PartitionTreeMemtable (#8080) 
* feat: switch partition tree to bulk

Signed-off-by: evenyag <realevenyag@gmail.com>

* chore: keep partition tree memtable for migration test

Restore PartitionTreeMemtable construction when memtable.type=partition_tree
is explicit, and move the sparse-encoding bulk override into the default
(no explicit memtable.type) arm so phase 2's memtable.type=bulk wins on
reopen. Rewrite test_reopen_time_series_sparse_memtable_with_bulk to use a
metric-engine-shaped schema and sparse-encoded rows with WriteHint::Sparse,
so the test actually exercises a PartitionTreeMemtable in phase 1 and
verifies WAL replay into the new BulkMemtable on reopen without flushing.

Signed-off-by: evenyag <realevenyag@gmail.com>

* chore: drop partition tree memtable from runtime

Re-apply the unconditional sparse-encoding override in
`MemtableBuilderProvider::builder_for_options` and route the
`MemtableOptions::PartitionTree` arm to `BulkMemtable` with a deprecation
warning. After this change, `PartitionTreeMemtableBuilder` is no longer
reachable from the engine runtime; benchmarks still reference the type.

Remove `test_reopen_time_series_sparse_memtable_with_bulk` and the
`put_sparse_rows` helper added in the previous commit — that test only
existed to validate the PartitionTree -> Bulk reopen migration and is
unnecessary now that the override is in place.

Signed-off-by: evenyag <realevenyag@gmail.com>

* refactor(mito2): move timestamp_array_to_i64_slice into read module

Relocate the timestamp_array_to_i64_slice helper from
memtable/partition_tree/data.rs to the read module so that the read
path no longer depends on the partition_tree internals. All call sites
(both inside and outside the partition_tree module) now import from
crate::read.

Signed-off-by: evenyag <realevenyag@gmail.com>

* refactor(mito2): use TimeSeriesMemtableBuilder in time_partition tests

The time_partition tests use the memtable builder purely as a generic
backend for the TimePartitions write/scan paths; nothing in them is
specific to the partition-tree memtable. Switch the seven affected
tests to TimeSeriesMemtableBuilder so the tests no longer depend on
PartitionTreeMemtableBuilder.

Signed-off-by: evenyag <realevenyag@gmail.com>

* chore(mito2): delete PartitionTreeMemtable implementation

The runtime already falls back to BulkMemtable for the PartitionTree
variant. Drop the now-unreachable implementation, its metrics, the
partition_tree benchmarks, the metric-engine Unsupported fallback in
bulk_insert.rs, and the test helpers that only existed for the deleted
module.

MemtableOptions::PartitionTree, its parsing, the runtime fallback, the
store-api MEMTABLE_PARTITION_TREE_* constants, and the SQL fixtures
remain so existing region options keep round-tripping.

Signed-off-by: evenyag <realevenyag@gmail.com>

* refactor(mito-codec): drop skip_partition_column parameter

PartitionTreeMemtable was the only caller passing
skip_partition_column=true; every other caller passes false. Now that
the partition_tree module is gone, the parameter is uniformly false
and the guard branch is dead. Drop the parameter from the trait method
and both impls, remove the guard and the is_partition_column helper,
and update the four remaining call sites in mito2 plus the bench.

Signed-off-by: evenyag <realevenyag@gmail.com>

* chore(mito2): remove unused MemtableConfig enum

Signed-off-by: evenyag <realevenyag@gmail.com>

* chore: fmt code

Signed-off-by: evenyag <realevenyag@gmail.com>

* refactor: remove unused variant

Signed-off-by: evenyag <realevenyag@gmail.com>

* test: update test_config_api

Signed-off-by: evenyag <realevenyag@gmail.com>

* fix: remove unused memtable test helpers

Signed-off-by: evenyag <realevenyag@gmail.com>

* chore: address review comment

Signed-off-by: evenyag <realevenyag@gmail.com>

* fix: support bulk memtable options

Signed-off-by: evenyag <realevenyag@gmail.com>

* fix: sanitize config

Signed-off-by: evenyag <realevenyag@gmail.com>

* feat: remove partition tree options from region options

Move primary_key_encoding to the top level

Signed-off-by: evenyag <realevenyag@gmail.com>

* test: make ssts test datetime replaced text stable

Signed-off-by: evenyag <realevenyag@gmail.com>

* test: update sqlness result

Signed-off-by: evenyag <realevenyag@gmail.com>

* chore: validate_enum_options consider bulk memtable

Signed-off-by: evenyag <realevenyag@gmail.com>

* refactor: pass region id when parsing region options

Replace the `TryFrom<&HashMap>` impl for `RegionOptions` with
`try_from_options(region_id, options_map)` so the legacy partition_tree
fallback can log the affected region. The fallback now also overrides
the SST format to flat in addition to clearing the memtable type.

Signed-off-by: evenyag <realevenyag@gmail.com>

* fix: align sst_format with bulk memtable on parse and open

Signed-off-by: evenyag <realevenyag@gmail.com>

---------

Signed-off-by: evenyag <realevenyag@gmail.com>
 2026-05-15 11:49:27 +00:00