greptimedb

mirror of https://github.com/GreptimeTeam/greptimedb.git synced 2026-01-07 13:52:59 +00:00

Author	SHA1	Message	Date
Sicong Hu	779865d389	feat: introduce IndexBuildTask for async index build (#6927 ) * feat: add framework for asynchronous index building Signed-off-by: SNC123 <sinhco@outlook.com> * test: add unit tests for IndexBuildTask Signed-off-by: SNC123 <sinhco@outlook.com> * chore: clippy,format,fix-udeps Signed-off-by: SNC123 <sinhco@outlook.com> * fix: correct write cache logic in IndexBuildTask Signed-off-by: SNC123 <sinhco@outlook.com> * chore: clippy, resolve conflicts Signed-off-by: SNC123 <sinhco@outlook.com> * chore: resolve conflicts Signed-off-by: SNC123 <sinhco@outlook.com> * fix: apply review suggestions Signed-off-by: SNC123 <sinhco@outlook.com> * chore: resolve conflicts Signed-off-by: SNC123 <sinhco@outlook.com> * fix: clean up index files in aborted case Signed-off-by: SNC123 <sinhco@outlook.com> * refactor: move manifest update logic into IndexBuildTask Signed-off-by: SNC123 <sinhco@outlook.com> * fix: enhance check file logic and error handling Signed-off-by: SNC123 <sinhco@outlook.com> --------- Signed-off-by: SNC123 <sinhco@outlook.com>	2025-10-10 03:29:32 +00:00
shuiyisong	b24a55cea4	chore: rename the default ts column name to `greptime_timestamp` for influxdb line protocol (#7046 ) * chore: rename influxdb ts column name to greptime_timestamp Signed-off-by: shuiyisong <xixing.sys@gmail.com> * fix: tests Signed-off-by: shuiyisong <xixing.sys@gmail.com> --------- Signed-off-by: shuiyisong <xixing.sys@gmail.com>	2025-10-09 02:14:11 +00:00
Ning Sun	660790148d	fix: various typos reported by CI (#7047 ) * fix: various typos reported by CI * fix: additional typo	2025-10-02 15:11:09 +00:00
zyy17	0717773f62	refactor!: add `enable_read_cache` config to support disable read cache explicitly (#6834 ) * refactor: add `enable_read_cache` config to support disable read cache explicitly Signed-off-by: zyy17 <zyylsxm@gmail.com> * refactor: if `cache_path` is empty and `enable_read_cache` is true, set the default cache dir Signed-off-by: zyy17 <zyylsxm@gmail.com> * refactor: remove the unessary Option type for `ObjectStorageCacheConfig` Signed-off-by: zyy17 <zyylsxm@gmail.com> * refactor: sanitize cache config in `DatanodeOptions` and `StandaloneOptions` Signed-off-by: zyy17 <zyylsxm@gmail.com> * chore: code review comment Signed-off-by: zyy17 <zyylsxm@gmail.com> * chore: apply code review comments Signed-off-by: zyy17 <zyylsxm@gmail.com> --------- Signed-off-by: zyy17 <zyylsxm@gmail.com>	2025-09-26 09:44:12 +00:00
Ruihang Xia	0790835c77	feat!: improve `greptime_identity` pipeline behavior (#6932 ) * flat by default, store array in string Signed-off-by: Ruihang Xia <waynestxia@gmail.com> * expose max_nested_levels param, store string instead of error Signed-off-by: Ruihang Xia <waynestxia@gmail.com> * remove flatten option Signed-off-by: Ruihang Xia <waynestxia@gmail.com> * remove unused errors Signed-off-by: Ruihang Xia <waynestxia@gmail.com> --------- Signed-off-by: Ruihang Xia <waynestxia@gmail.com>	2025-09-25 15:28:28 +00:00
dennis zhuang	91a727790d	feat: supports permission mode for static user provider (#7017 ) * feat: supports permission mode for static user provider Signed-off-by: Dennis Zhuang <killme2008@gmail.com> * chore: style Signed-off-by: Dennis Zhuang <killme2008@gmail.com> * fix: comment Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> --------- Signed-off-by: Dennis Zhuang <killme2008@gmail.com> Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>	2025-09-25 03:45:31 +00:00
Yingwen	b8e0c49cb4	feat: add an flag to enable the experimental flat format (#6976 ) * feat: add enable_experimental_flat_format flag to enable flat format Signed-off-by: evenyag <realevenyag@gmail.com> * refactor: extract build_scan_input for CompactionSstReaderBuilder Signed-off-by: evenyag <realevenyag@gmail.com> * chore: add compact memtable cost to flush metrics Signed-off-by: evenyag <realevenyag@gmail.com> * feat: Sets compact dispatcher for bulk memtable Signed-off-by: evenyag <realevenyag@gmail.com> * feat: Cast dictionary to target type in FlatProjectionMapper Signed-off-by: evenyag <realevenyag@gmail.com> * fix: add time index to FlatProjectionMapper::batch_schema Signed-off-by: evenyag <realevenyag@gmail.com> * chore: update config toml Signed-off-by: evenyag <realevenyag@gmail.com> * fix: pass flat_format to ProjectionMapper in CompactionSstReaderBuilder Signed-off-by: evenyag <realevenyag@gmail.com> --------- Signed-off-by: evenyag <realevenyag@gmail.com>	2025-09-16 09:33:12 +00:00
shuiyisong	ac051af201	feat(pipeline): generate create table sql from pipeline config (#6930 ) * chore: add expr_to_create function using cc and polish Signed-off-by: shuiyisong <xixing.sys@gmail.com> * feat: add get pipeline create table Signed-off-by: shuiyisong <xixing.sys@gmail.com> * chore: update test_expr_to_create Signed-off-by: shuiyisong <xixing.sys@gmail.com> * fix: column extension Signed-off-by: shuiyisong <xixing.sys@gmail.com> * chore: add message hint for variant table name Signed-off-by: shuiyisong <xixing.sys@gmail.com> * chore: add message hint for existing table Signed-off-by: shuiyisong <xixing.sys@gmail.com> * test: create table for pipeline Signed-off-by: shuiyisong <xixing.sys@gmail.com> * chore: update comment Signed-off-by: shuiyisong <xixing.sys@gmail.com> * chore: rename to query pipeline ddl Signed-off-by: shuiyisong <xixing.sys@gmail.com> --------- Signed-off-by: shuiyisong <xixing.sys@gmail.com>	2025-09-09 02:47:51 +00:00
Ruihang Xia	c9377e7c5a	build: bump rust edition to 2024 (#6920 ) * bump edition Signed-off-by: Ruihang Xia <waynestxia@gmail.com> * format Signed-off-by: Ruihang Xia <waynestxia@gmail.com> * gen keyword Signed-off-by: Ruihang Xia <waynestxia@gmail.com> * lifetime and env var Signed-off-by: Ruihang Xia <waynestxia@gmail.com> * one more gen fix Signed-off-by: Ruihang Xia <waynestxia@gmail.com> * lifetime of temporaries in tail expressions Signed-off-by: Ruihang Xia <waynestxia@gmail.com> * format again Signed-off-by: Ruihang Xia <waynestxia@gmail.com> * clippy nested if Signed-off-by: Ruihang Xia <waynestxia@gmail.com> * clippy let and return Signed-off-by: Ruihang Xia <waynestxia@gmail.com> --------- Signed-off-by: Ruihang Xia <waynestxia@gmail.com>	2025-09-08 02:37:18 +00:00
localhost	756856799f	refactor(pipeline)!: change dispatch table name format (#6901 ) * chore(breaking): change dispatch table name format * chore: fix test	2025-09-03 13:47:40 +00:00
Yingwen	ab96703d8f	chore: enlarge max file limit to 384 (#6868 ) chore: enlarge max concurrent files to 384 Signed-off-by: evenyag <realevenyag@gmail.com>	2025-09-01 09:26:20 +00:00
discord9	bacd9c7d15	feat: add event ts to region manifest (#6751 ) * feat: add event ts to region manifest Signed-off-by: discord9 <discord9@163.com> delete files Signed-off-by: discord9 <discord9@163.com> chore: clippy Signed-off-by: discord9 <discord9@163.com> lower concurrency Signed-off-by: discord9 <discord9@163.com> feat: gc use delta manifest to get expel time Signed-off-by: discord9 <discord9@163.com> docs: terminalogy Signed-off-by: discord9 <discord9@163.com> refactor: some advices from review Signed-off-by: discord9 <discord9@163.com> feat: manifest add removed files field Signed-off-by: discord9 <discord9@163.com> feat(WIP): add remove time in manifest Signed-off-by: discord9 <discord9@163.com> wip: more config Signed-off-by: discord9 <discord9@163.com> feat: manifest uodate removed files Signed-off-by: discord9 <discord9@163.com> test: add remove file opts field Signed-off-by: discord9 <discord9@163.com> test: fix test Signed-off-by: discord9 <discord9@163.com> chore: delete gc.rs Signed-off-by: discord9 <discord9@163.com> * feat: proper option name Signed-off-by: discord9 <discord9@163.com> * refactor: per review Signed-off-by: discord9 <discord9@163.com> * test: update manifest size Signed-off-by: discord9 <discord9@163.com> * test: fix eq Signed-off-by: discord9 <discord9@163.com> * refactor: some per review Signed-off-by: discord9 <discord9@163.com> * refactor: per review Signed-off-by: discord9 <discord9@163.com> * refactor: more per review Signed-off-by: discord9 <discord9@163.com> * test: update manifest size Signed-off-by: discord9 <discord9@163.com> * test: update config Signed-off-by: discord9 <discord9@163.com> * feat: keep count 0 means only use ttl Signed-off-by: discord9 <discord9@163.com> --------- Signed-off-by: discord9 <discord9@163.com>	2025-08-28 09:08:18 +00:00
Ning Sun	69eed2c3fa	feat: only show prometheus logical tables for __name__ values query (#6814 ) feat: only show prometheus logical tables for __name__ query Signed-off-by: Ning Sun <sunning@greptime.com>	2025-08-25 15:04:42 +00:00
Ning Sun	48572d18a8	feat: name label regex matcher in label values api (#6799 ) * test: add failing test for #6791 * test: add support for = and =~ * fix: lint * fix: code merge issue Signed-off-by: Ning Sun <sunning@greptime.com> --------- Signed-off-by: Ning Sun <sunning@greptime.com>	2025-08-25 08:48:53 +00:00
Ning Sun	68ac37461b	feat: add limit to label value api (#6795 ) * feat: add limit to label value api Signed-off-by: Ning Sun <sunning@greptime.com> * feat: limit for special labels Signed-off-by: Ning Sun <sunning@greptime.com> --------- Signed-off-by: Ning Sun <sunning@greptime.com>	2025-08-23 06:23:51 +00:00
LFC	f9d2a89a0c	chore: update datafusion family (#6675 ) * chore: update datafusion family Signed-off-by: luofucong <luofc@foxmail.com> * fix ci Signed-off-by: luofucong <luofc@foxmail.com> * use official otel-arrow-rust Signed-off-by: luofucong <luofc@foxmail.com> * rebase Signed-off-by: luofucong <luofc@foxmail.com> * use the official orc-rust Signed-off-by: luofucong <luofc@foxmail.com> * resolve PR comments Signed-off-by: luofucong <luofc@foxmail.com> * remove the empty lines Signed-off-by: luofucong <luofc@foxmail.com> * try following PR comments Signed-off-by: luofucong <luofc@foxmail.com> --------- Signed-off-by: luofucong <luofc@foxmail.com>	2025-08-15 12:41:49 +00:00
sunheyi	d03f85287e	feat: mysql add prepared_stmt_cache_capacity (#6639 ) * feat: your clear and concise commit message Signed-off-by: sunheyi <1061867552@qq.com> * fix error Signed-off-by: sunheyi <1061867552@qq.com> * add param Signed-off-by: sunheyi <1061867552@qq.com> * fix Signed-off-by: sunheyi <1061867552@qq.com> * fix doc error Signed-off-by: sunheyi <1061867552@qq.com> --------- Signed-off-by: sunheyi <1061867552@qq.com>	2025-08-14 08:19:10 +00:00
zyy17	777da35b0d	refactor: unify the event recorder (#6689 ) * refactor: unify the event recorder Signed-off-by: zyy17 <zyylsxm@gmail.com> * refactor: add `table_name()` in `Event` trait Signed-off-by: zyy17 <zyylsxm@gmail.com> * chore: add `slow_query_options` in `Instance` Signed-off-by: zyy17 <zyylsxm@gmail.com> * refactor: add `EventHandlerOptions` and `options()` in `EventHandler` trait Signed-off-by: zyy17 <zyylsxm@gmail.com> * chore: add `aggregate_events_by_type()` and support log mode of slow query Signed-off-by: zyy17 <zyylsxm@gmail.com> * chore: polish the code Signed-off-by: zyy17 <zyylsxm@gmail.com> * fix: clippy errors Signed-off-by: zyy17 <zyylsxm@gmail.com> * chore: support to set ttl by using extension of query context Signed-off-by: zyy17 <zyylsxm@gmail.com> * chore: refine the configs fields Signed-off-by: zyy17 <zyylsxm@gmail.com> * fix: sqlness test errors Signed-off-by: zyy17 <zyylsxm@gmail.com> * refactor: use `Duration` type instead of `String` for ttl fields Signed-off-by: zyy17 <zyylsxm@gmail.com> * refactor: use pre-allocation for building RowInsertRequests Signed-off-by: zyy17 <zyylsxm@gmail.com> * chore: fix clippy errors Signed-off-by: zyy17 <zyylsxm@gmail.com> * refactor: code review Signed-off-by: zyy17 <zyylsxm@gmail.com> * chore: fix integration errors Signed-off-by: zyy17 <zyylsxm@gmail.com> * refactor: polish code for `group_events_by_type()` and `build_row_inserts_request()`, also add the unit tests Signed-off-by: zyy17 <zyylsxm@gmail.com> * chore: refine comments --------- Signed-off-by: zyy17 <zyylsxm@gmail.com>	2025-08-12 18:26:12 +00:00
Ruihang Xia	0781adaa3d	feat: new HTTP API for formatting SQL (#6691 ) Signed-off-by: Ruihang Xia <waynestxia@gmail.com>	2025-08-09 07:39:41 +00:00
LFC	253d89b5cc	feat: able to set read preference to flownode (#6696 ) fix: correctly compare the opened follower regions in startup Signed-off-by: luofucong <luofc@foxmail.com>	2025-08-08 09:08:09 +00:00
localhost	3a2f5413e0	chore: add and/or for log query (#6681 ) * chore: add and/or for log query * chore: remove impl From<Vec<ColumnFilters>> for Filters	2025-08-08 08:48:03 +00:00
zyy17	3a9f0220b5	fix: unable to record slow query (#6590 ) * refactor: add process manager for prometheus query Signed-off-by: zyy17 <zyylsxm@gmail.com> * refactor: modify `register_query()` API to accept parsed statement(`catalog::process_manager::QueryStatement`) Signed-off-by: zyy17 <zyylsxm@gmail.com> * refactor: add the slow query timer in the `Tikcet` of ProcessManager Signed-off-by: zyy17 <zyylsxm@gmail.com> * test: add integration tests Signed-off-by: zyy17 <zyylsxm@gmail.com> * refactor: add process manager in `do_exec_plan()` Signed-off-by: zyy17 <zyylsxm@gmail.com> * tests: add `test_postgres_slow_query` integration test Signed-off-by: zyy17 <zyylsxm@gmail.com> * chore: polish the code Signed-off-by: zyy17 <zyylsxm@gmail.com> * refactor: create a query ticket and slow query timer if the statement is a query in `query_statement()` Signed-off-by: zyy17 <zyylsxm@gmail.com> * fix: sqlness errors Signed-off-by: zyy17 <zyylsxm@gmail.com> --------- Signed-off-by: zyy17 <zyylsxm@gmail.com>	2025-08-06 03:35:12 +00:00
Ning Sun	29e0092468	feat: schema/database support for label_values (#6631 ) * feat: initial support for __schema__ in label values * feat: filter database with matches * refactor: skip unnecessary check * fix: resolve schema matcher in label values * test: add a test case for table not exists * refactor: add matchop check on db label * chore: merge main	2025-08-04 11:56:10 +00:00
Yingwen	280024d7f8	feat: Add option to limit the files reading simultaneously (#6635 ) * feat: limits the max number of files to scan at the same time Signed-off-by: evenyag <realevenyag@gmail.com> * feat: make max_concurrent_scan_files configurable Signed-off-by: evenyag <realevenyag@gmail.com> * feat: reduce concurrent scan files to 128 Signed-off-by: evenyag <realevenyag@gmail.com> * docs: update config example Signed-off-by: evenyag <realevenyag@gmail.com> * test: add test for max_concurrent_scan_files Signed-off-by: evenyag <realevenyag@gmail.com> * style: fix clippy Signed-off-by: evenyag <realevenyag@gmail.com> * test: update config test Signed-off-by: evenyag <realevenyag@gmail.com> --------- Signed-off-by: evenyag <realevenyag@gmail.com>	2025-08-04 07:18:58 +00:00
Ruihang Xia	572e29b158	feat: support tls for pg backend (#6611 ) * load tls Signed-off-by: Ruihang Xia <waynestxia@gmail.com> * impl tls Signed-off-by: Ruihang Xia <waynestxia@gmail.com> * pass options Signed-off-by: Ruihang Xia <waynestxia@gmail.com> * implement require mode Signed-off-by: Ruihang Xia <waynestxia@gmail.com> * clean up Signed-off-by: Ruihang Xia <waynestxia@gmail.com> * update config Signed-off-by: Ruihang Xia <waynestxia@gmail.com> * fix clippy Signed-off-by: Ruihang Xia <waynestxia@gmail.com> * default to prefer Signed-off-by: Ruihang Xia <waynestxia@gmail.com> * update example config Signed-off-by: Ruihang Xia <waynestxia@gmail.com> * adjust example config Signed-off-by: Ruihang Xia <waynestxia@gmail.com> * handle client cert and key properly Signed-off-by: Ruihang Xia <waynestxia@gmail.com> * implement verify_ca and verify_full Signed-off-by: Ruihang Xia <waynestxia@gmail.com> * update integration test for config api Signed-off-by: Ruihang Xia <waynestxia@gmail.com> * change config name and default mode Signed-off-by: Ruihang Xia <waynestxia@gmail.com> --------- Signed-off-by: Ruihang Xia <waynestxia@gmail.com>	2025-08-04 00:41:08 +00:00
Ruihang Xia	9817eb934d	feat: support `__schema__` and `__database__` in Prom Remote Read (#6610 ) * feat: support __schema__ and __database__ in Prom remote R/W Signed-off-by: Ruihang Xia <waynestxia@gmail.com> * fix integration test Signed-off-by: Ruihang Xia <waynestxia@gmail.com> * revert remote write changes Signed-off-by: Ruihang Xia <waynestxia@gmail.com> * check matcher type Signed-off-by: Ruihang Xia <waynestxia@gmail.com> --------- Signed-off-by: Ruihang Xia <waynestxia@gmail.com>	2025-08-03 07:09:44 +00:00
shuiyisong	9e2f793b04	chore(otlp_metric): update metric and label naming (#6624 ) * chore: update otlp metrics & labels naming Signed-off-by: shuiyisong <xixing.sys@gmail.com> * fix: typo and test Signed-off-by: shuiyisong <xixing.sys@gmail.com> * Update src/session/src/protocol_ctx.rs * chore: add test cases for normalizing functions Signed-off-by: shuiyisong <xixing.sys@gmail.com> --------- Signed-off-by: shuiyisong <xixing.sys@gmail.com> Co-authored-by: Ning Sun <classicning@gmail.com>	2025-08-01 08:17:12 +00:00
Yingwen	9527e0df2f	feat: HTTP API to activate/deactive heap prof (activate by default) (#6593 ) * feat: add HTTP API to activate/deactivate heap profiling Signed-off-by: evenyag <realevenyag@gmail.com> * feat: add HTTP API to get profiling status Signed-off-by: evenyag <realevenyag@gmail.com> * feat: enable heap prof by default Signed-off-by: evenyag <realevenyag@gmail.com> * build: add "prof:true,prof_active:false" as default env to dockerfiles Signed-off-by: evenyag <realevenyag@gmail.com> * feat: activate heap profiling after log initialization Signed-off-by: evenyag <realevenyag@gmail.com> * feat: add memory options to control whether to activate profiling Signed-off-by: evenyag <realevenyag@gmail.com> * docs: update docs Signed-off-by: evenyag <realevenyag@gmail.com> * chore: fmt toml Signed-off-by: evenyag <realevenyag@gmail.com> * test: fix config test Signed-off-by: evenyag <realevenyag@gmail.com> * docs: usage of new api Signed-off-by: evenyag <realevenyag@gmail.com> * chore: log profile after version Signed-off-by: evenyag <realevenyag@gmail.com> * docs: update how to docs Signed-off-by: evenyag <realevenyag@gmail.com> * docs: fix how to docs Signed-off-by: evenyag <realevenyag@gmail.com> --------- Signed-off-by: evenyag <realevenyag@gmail.com>	2025-08-01 03:24:56 +00:00
shuiyisong	51dc393371	chore(otlp_metric): support attr list in header opts (#6617 ) * chore: support attr list in OTLP metrics Signed-off-by: shuiyisong <xixing.sys@gmail.com> * chore: fix cr issue Signed-off-by: shuiyisong <xixing.sys@gmail.com> --------- Signed-off-by: shuiyisong <xixing.sys@gmail.com>	2025-07-31 08:54:45 +00:00
shuiyisong	2b4fb2f32a	refactor(otlp_metric): make otlp metric compatible with promql (#6543 ) * chore: tmp save Signed-off-by: shuiyisong <xixing.sys@gmail.com> * chore: minor update * chore: remove metric metadata and introduce shared attrs Signed-off-by: shuiyisong <xixing.sys@gmail.com> * chore: replace . with _ in metric name Signed-off-by: shuiyisong <xixing.sys@gmail.com> * chore: minor update & fix tests Signed-off-by: shuiyisong <xixing.sys@gmail.com> * chore: add legacy mode param to otlp metrics Signed-off-by: shuiyisong <xixing.sys@gmail.com> * chore: update test Signed-off-by: shuiyisong <xixing.sys@gmail.com> * chore: update test & fix Signed-off-by: shuiyisong <xixing.sys@gmail.com> * chore: add automatically legacy check for otlp metrics Signed-off-by: shuiyisong <xixing.sys@gmail.com> * chore: fix clippy Signed-off-by: shuiyisong <xixing.sys@gmail.com> * fix: typos Signed-off-by: shuiyisong <xixing.sys@gmail.com> * chore: insert table options in compat mode & add test Signed-off-by: shuiyisong <xixing.sys@gmail.com> * fix: check table options consistency Signed-off-by: shuiyisong <xixing.sys@gmail.com> * chore: update test and add comments Signed-off-by: shuiyisong <xixing.sys@gmail.com> * chore: minor tags update Signed-off-by: shuiyisong <xixing.sys@gmail.com> * chore: minor update about scope labeling Signed-off-by: shuiyisong <xixing.sys@gmail.com> * chore: update opts using header & update test Signed-off-by: shuiyisong <xixing.sys@gmail.com> * chore: minor code refactor Signed-off-by: shuiyisong <xixing.sys@gmail.com> * chore: fix cr issue Signed-off-by: shuiyisong <xixing.sys@gmail.com> --------- Signed-off-by: shuiyisong <xixing.sys@gmail.com>	2025-07-30 11:20:03 +00:00
discord9	8fef177575	feat: fallback when failed to push down using `DistPlanner` (#6574 ) * test: fix fallback testcase Signed-off-by: discord9 <discord9@163.com> * add metric Signed-off-by: discord9 <discord9@163.com> * feat: fallback add to config variable Signed-off-by: discord9 <discord9@163.com> * feat: set in var&set in hint Signed-off-by: discord9 <discord9@163.com> * chore: update test Signed-off-by: discord9 <discord9@163.com> * feat: also in toml config Signed-off-by: discord9 <discord9@163.com> * fix test Signed-off-by: discord9 <discord9@163.com> * docs: comment about setting from different source Signed-off-by: discord9 <discord9@163.com> --------- Signed-off-by: discord9 <discord9@163.com>	2025-07-29 04:37:00 +00:00
Zhenchi	2298227e0c	refactor: refactor partition mod to use PartitionExpr instead of PartitionDef (#6554 ) * refactor: refactor partition mod to use PartitionExpr instead of PartitionDef Signed-off-by: Zhenchi <zhongzc_arch@outlook.com> * fix snafu Signed-off-by: Zhenchi <zhongzc_arch@outlook.com> * Puts expression into PbPartition Signed-off-by: Zhenchi <zhongzc_arch@outlook.com> * address comments Signed-off-by: Zhenchi <zhongzc_arch@outlook.com> * fix compile Signed-off-by: Zhenchi <zhongzc_arch@outlook.com> * update proto Signed-off-by: Zhenchi <zhongzc_arch@outlook.com> * add serde test Signed-off-by: Zhenchi <zhongzc_arch@outlook.com> * add serde test Signed-off-by: Zhenchi <zhongzc_arch@outlook.com> --------- Signed-off-by: Zhenchi <zhongzc_arch@outlook.com>	2025-07-23 03:51:28 +00:00
discord9	bbc9f3ea1e	refactor: expose flow batching mode constants to config (#6442 ) * refactor: make flow batching mode constant to configs Signed-off-by: discord9 <discord9@163.com> * docs: config docs Signed-off-by: discord9 <discord9@163.com> * docs: update code comment Signed-off-by: discord9 <discord9@163.com> * test: fix test_config_api Signed-off-by: discord9 <discord9@163.com> * feat: more batch opts Signed-off-by: discord9 <discord9@163.com> * fix after rebase Signed-off-by: discord9 <discord9@163.com> * chore: per review Signed-off-by: discord9 <discord9@163.com> * per review experimental options Signed-off-by: discord9 <discord9@163.com> --------- Signed-off-by: discord9 <discord9@163.com>	2025-07-16 08:05:20 +00:00
dennis zhuang	411eb768b1	feat: supports null reponse format for http API (#6531 ) * feat: supports null reponse format for http API Signed-off-by: Dennis Zhuang <killme2008@gmail.com> * fix: license header and assertion Signed-off-by: Dennis Zhuang <killme2008@gmail.com> * chore: in seconds Signed-off-by: Dennis Zhuang <killme2008@gmail.com> --------- Signed-off-by: Dennis Zhuang <killme2008@gmail.com>	2025-07-16 03:46:39 +00:00
shuiyisong	582bcc3b14	feat(pipeline): filter processor (#6502 ) * feat: add filter processor Signed-off-by: shuiyisong <xixing.sys@gmail.com> * test: add tests Signed-off-by: shuiyisong <xixing.sys@gmail.com> * chore: change target to list and use `in` and `not_in` Signed-off-by: shuiyisong <xixing.sys@gmail.com> * chore: rebase main and fix error Signed-off-by: shuiyisong <xixing.sys@gmail.com> --------- Signed-off-by: shuiyisong <xixing.sys@gmail.com>	2025-07-13 23:18:42 +00:00
Ning Sun	eeb061ca74	feat: allow float number literal in step (#6483 ) * chore: allow float number literal as step Signed-off-by: Ning Sun <sunning@greptime.com> * chore: switch to released version of promql parser Signed-off-by: Ning Sun <sunning@greptime.com> --------- Signed-off-by: Ning Sun <sunning@greptime.com>	2025-07-09 03:09:09 +00:00
shuiyisong	f7282fde28	chore: sort range query return values (#6474 ) * chore: sort range query return values * chore: add comments * chore: add is_sorted check * fix: test	2025-07-09 02:27:12 +00:00
Zhenchi	599f289f59	feat: add `granularity` and `false_positive_rate` options for indexes (#6416 ) * feat: add `granularity` and `false_positive_rate` options for indexes Signed-off-by: Zhenchi <zhongzc_arch@outlook.com> * address comments Signed-off-by: Zhenchi <zhongzc_arch@outlook.com> * upgrade proto Signed-off-by: Zhenchi <zhongzc_arch@outlook.com> --------- Signed-off-by: Zhenchi <zhongzc_arch@outlook.com>	2025-07-02 07:33:39 +00:00
shuiyisong	dec8c52b18	feat(pipeline): support Loki API (#6390 ) * chore: use schema_info Signed-off-by: shuiyisong <xixing.sys@gmail.com> * refactor: abstract loki item generator Signed-off-by: shuiyisong <xixing.sys@gmail.com> * chore: introduce middle item Signed-off-by: shuiyisong <xixing.sys@gmail.com> * feat: introduce pipeline in loki api Signed-off-by: shuiyisong <xixing.sys@gmail.com> * test: add tests Signed-off-by: shuiyisong <xixing.sys@gmail.com> * chore: minor update Signed-off-by: shuiyisong <xixing.sys@gmail.com> * chore: minor update Signed-off-by: shuiyisong <xixing.sys@gmail.com> * chore: update prefix and test Signed-off-by: shuiyisong <xixing.sys@gmail.com> * chore: change recursion to loop Signed-off-by: shuiyisong <xixing.sys@gmail.com> * fix: cr issue Signed-off-by: shuiyisong <xixing.sys@gmail.com> --------- Signed-off-by: shuiyisong <xixing.sys@gmail.com>	2025-06-28 01:01:08 +00:00
dennis zhuang	944b4b3e49	feat: supports CsvWithNames and CsvWithNamesAndTypes formats (#6384 ) * feat: supports CsvWithNames and CsvWithNamesAndTypes formats and object/array types Signed-off-by: Dennis Zhuang <killme2008@gmail.com> * test: added and fixed tests Signed-off-by: Dennis Zhuang <killme2008@gmail.com> * chore: fix test Signed-off-by: Dennis Zhuang <killme2008@gmail.com> * chore: remove comments Signed-off-by: Dennis Zhuang <killme2008@gmail.com> * test: add json type csv tests Signed-off-by: Dennis Zhuang <killme2008@gmail.com> * chore: remove comment Co-authored-by: Yingwen <realevenyag@gmail.com> --------- Signed-off-by: Dennis Zhuang <killme2008@gmail.com> Co-authored-by: Yingwen <realevenyag@gmail.com>	2025-06-25 07:28:11 +00:00
zyy17	90a3894564	refactor: always write `parent_span_id` for otlp traces ingestion (#6356 ) * refactor: always write `parent_span_id` for otlp traces ingestion Signed-off-by: zyy17 <zyylsxm@gmail.com> * refactor: support to write None value in row writer Signed-off-by: zyy17 <zyylsxm@gmail.com> --------- Signed-off-by: zyy17 <zyylsxm@gmail.com>	2025-06-23 11:36:57 +00:00
shuiyisong	7cd6be41ce	feat(pipeline): introduce pipeline doc version 2 for combine-transform (#6360 ) * chore: init commit of pipeline doc version v2 Signed-off-by: shuiyisong <xixing.sys@gmail.com> * chore: remove unused code Signed-off-by: shuiyisong <xixing.sys@gmail.com> * chore: remove unused code Signed-off-by: shuiyisong <xixing.sys@gmail.com> * chore: add test Signed-off-by: shuiyisong <xixing.sys@gmail.com> * chore: add test Signed-off-by: shuiyisong <xixing.sys@gmail.com> * chore: compatible with v1 to remain field in the map during transform Signed-off-by: shuiyisong <xixing.sys@gmail.com> * refactor: pipeline.exec_mut Signed-off-by: shuiyisong <xixing.sys@gmail.com> * fix: typo Signed-off-by: shuiyisong <xixing.sys@gmail.com> * chore: change from v2 to 2 in version setting Signed-off-by: shuiyisong <xixing.sys@gmail.com> --------- Signed-off-by: shuiyisong <xixing.sys@gmail.com>	2025-06-22 00:58:36 +00:00
rgidda	e026f766d2	feat(storage): Add skip_ssl_validation option for object storage HTTP client (#6358 ) * feat(storage): Add skip_ssl_validation option for object storage HTTP client Signed-off-by: rgidda <rgidda@hitachivantara.com> * fix(test): Broken test case for - Add skip_ssl_validation option for object storage HTTP client Signed-off-by: rgidda <rgidda@hitachivantara.com> * fix: test * fix: test --------- Signed-off-by: rgidda <rgidda@hitachivantara.com> Co-authored-by: rgidda <rgidda@hitachivantara.com> Co-authored-by: dennis zhuang <killme2008@gmail.com>	2025-06-20 08:08:19 +00:00
zyy17	f6ce6fe385	fix(jaeger-api): incorrect `find_traces()` logic and multiple api compatible issues (#6293 ) * fix: use `limit` params in jaeger http Signed-off-by: zyy17 <zyylsxm@gmail.com> * refactor: only parse `max_duration` and `min_duration` when it's not empty Signed-off-by: zyy17 <zyylsxm@gmail.com> * fix: handle the input for empty `limit` string Signed-off-by: zyy17 <zyylsxm@gmail.com> * fix: missing the fileter for `service_name` Signed-off-by: zyy17 <zyylsxm@gmail.com> * test: fix ci errors Signed-off-by: zyy17 <zyylsxm@gmail.com> * fix: incorrect behavior of find_traces Signed-off-by: zyy17 <zyylsxm@gmail.com> * fix: the logic of `find_traces()` The correct logic should be: 1. Get all trace ids that match the filters; 2. Get all traces that match the trace ids from the previous query; Signed-off-by: zyy17 <zyylsxm@gmail.com> * fix: integration test errors Signed-off-by: zyy17 <zyylsxm@gmail.com> * refactor: add `empty_string_as_none` Signed-off-by: zyy17 <zyylsxm@gmail.com> * refactor: refine naming Signed-off-by: zyy17 <zyylsxm@gmail.com> --------- Signed-off-by: zyy17 <zyylsxm@gmail.com>	2025-06-18 08:01:36 +00:00
localhost	53c4fd478e	chore: add skip error for pipeline skip error log (#6318 ) * chore: wip Signed-off-by: paomian <xpaomian@gmail.com> * chore: add skip error for pipeline skip error log Signed-off-by: paomian <xpaomian@gmail.com> * chore: add test and check timestamp must be non null Signed-off-by: paomian <xpaomian@gmail.com> * chore: fix test * chore: fix by pr comment * fix: typo Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> --------- Signed-off-by: paomian <xpaomian@gmail.com> Co-authored-by: dennis zhuang <killme2008@gmail.com> Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>	2025-06-17 06:44:11 +00:00
shuiyisong	079daf5db9	feat: support special labels parsing in prom remote write (#6302 ) * feat: support special labels parsing in prom remote write * chore: change __schema__ to __database__ * fix: test Signed-off-by: shuiyisong <xixing.sys@gmail.com> * fix: remove the missing type alias Signed-off-by: shuiyisong <xixing.sys@gmail.com> * chore: update cr issue Co-authored-by: Lei, HUANG <6406592+v0y4g3r@users.noreply.github.com> --------- Signed-off-by: shuiyisong <xixing.sys@gmail.com> Co-authored-by: Lei, HUANG <6406592+v0y4g3r@users.noreply.github.com>	2025-06-17 03:20:33 +00:00
Yingwen	2a3445c72c	fix: ignore missing columns and tables in PromQL (#6285 ) * fix: handle table/column not found in or Signed-off-by: evenyag <realevenyag@gmail.com> * test: update result Signed-off-by: evenyag <realevenyag@gmail.com> * test: drop table after test Signed-off-by: evenyag <realevenyag@gmail.com> * test: fix test cases Signed-off-by: evenyag <realevenyag@gmail.com> * fix: do not return table not found error in series_query Signed-off-by: evenyag <realevenyag@gmail.com> --------- Signed-off-by: evenyag <realevenyag@gmail.com>	2025-06-16 12:15:38 +00:00
Lei, HUANG	1d53dd26ae	chore: add option for arrow flight compression mode (#6283 ) * chore/enable-flight-encoder: ### Add Flight Compression Support - Configuration Updates: - Added `grpc.flight_compression` option to `config/config.md`, `config/datanode.example.toml`, and `config/frontend.example.toml` to specify compression modes for Arrow IPC service. - Code Enhancements: - Updated `FlightEncoder` in `src/common/grpc/src/flight.rs` to support compression modes. - Modified `RegionServer` and `DatanodeBuilder` in `src/datanode/src/datanode.rs` and `src/datanode/src/region_server.rs` to handle `FlightCompression`. - Integrated `FlightCompression` in `src/servers/src/grpc.rs` and `src/servers/src/grpc/flight.rs` to manage compression settings. - Testing and Integration: - Updated test utilities and integration tests in `tests-integration/src/grpc/flight.rs` and `tests-integration/src/test_util.rs` to include `FlightCompression`. Signed-off-by: Lei, HUANG <mrsatangel@gmail.com> * chore/enable-flight-encoder: ### Enable Compression in FlightClient - `client.rs`: Updated `make_flight_client` to accept `send_compression` and `accept_compression` parameters, enabling Zstd compression for sending and receiving messages. - `client_manager.rs`: Modified `datanode` method to pass compression settings from `ChannelConfig` to `RegionRequester`. - `database.rs`: Adjusted calls to `make_flight_client` to include compression parameters. - `region.rs`: Updated `RegionRequester` to store and utilize compression settings. - `frontend.rs`: Configured `ChannelConfig` to enable compression based on options. - `channel_manager.rs`: Added `send_compression` and `accept_compression` fields to `ChannelConfig` with default values and updated tests accordingly. Signed-off-by: Lei, HUANG <lhuang@greptime.com> * chore/enable-flight-encoder: ### Update Compression Defaults and Documentation - Configuration Files: Updated `datanode.example.toml` and `frontend.example.toml` to include a default setting comment for `flight_compression`, specifying it defaults to `none`. - gRPC Server Code: Modified `grpc.rs` to set `None` as the default for `FlightCompression` instead of `ArrowIpc`. Signed-off-by: Lei, HUANG <lhuang@greptime.com> --------- Signed-off-by: Lei, HUANG <mrsatangel@gmail.com> Signed-off-by: Lei, HUANG <lhuang@greptime.com>	2025-06-11 06:54:10 +00:00
zyy17	e434294a0c	refactor: support to get trace id with time range (#6236 ) * refactor: add time range for getting trace id * test: add unit test	2025-06-09 08:53:20 +00:00
shuiyisong	538b5abaae	chore: support table suffix in hint (#6223 ) * feat: pipeline recognize hints from exec * chore: rename and add test * chore: minor improve * chore: rename and add comments * fix: typos * feat: add initial impl for vrl processor * chore: update processors to allow vrl process * feat: pipeline recognize hints from exec * chore: rename and add test * chore: minor improve * chore: rename and add comments * fix: typos * chore: remove unnecessory clone fn * chore: group metrics * chore: use struct in transform output enum * test: add test for vrl * fix: leaked conflicts * chore: merge branch code & add check in compile * fix: check condition * fix: check auto-transform timeindex * chore: support table_suffix in hint * chore: add test for table suffix in vrl hint * refactor: change context_opt to a struct	2025-06-06 20:39:10 +00:00

1 2 3 4 5 ...

272 Commits