discord9
37bc2e6b07
feat: gc worker heartbeat instruction ( #7118 )
...
again
false by default
test: config api
refactor: per code review
less info!
even less info!!
docs: gc regions instr
refactor: grp by region id
per code review
per review
error handling?
test: fix
todos
aft rebase fix
after refactor
Signed-off-by: discord9 <discord9@163.com >
2025-10-29 02:59:36 +00:00
zyy17
0a3961927d
refactor!: add a opentelemetry_traces_operations table to aggregate (service_name, span_name, span_kind) to improve query performance ( #7144 )
...
refactor: add a `*_operations` table to aggregate `(service_name, span_name, span_kind)` to improve query performance
Signed-off-by: zyy17 <zyylsxm@gmail.com >
2025-10-27 03:36:22 +00:00
LFC
2f637a262e
chore: update datafusion to 50 ( #7076 )
...
* chore: update datafusion to 50
Signed-off-by: luofucong <luofc@foxmail.com >
* fix ci
Signed-off-by: luofucong <luofc@foxmail.com >
* fix: update datafusion_pg_catalog import
* chore: fix toml format
* chore: fix toml format again
* fix nextest
Signed-off-by: luofucong <luofc@foxmail.com >
* fix sqlness
Signed-off-by: luofucong <luofc@foxmail.com >
* chore: switch datafusion-orc to upstream tag
* fix sqlness
Signed-off-by: luofucong <luofc@foxmail.com >
* resolve PR comments
Signed-off-by: luofucong <luofc@foxmail.com >
---------
Signed-off-by: luofucong <luofc@foxmail.com >
Co-authored-by: Ning Sun <sunning@greptime.com >
2025-10-23 07:18:36 +00:00
jeremyhi
62b51c6736
feat: writer mem limiter for http and grpc service ( #7092 )
...
* feat: writer mem limiter for http and grpc service
Signed-off-by: jeremyhi <fengjiachun@gmail.com >
* fix: docs
Signed-off-by: jeremyhi <fengjiachun@gmail.com >
* feat: add metrics for limiter
Signed-off-by: jeremyhi <fengjiachun@gmail.com >
* Apply suggestion from @MichaelScofield
Co-authored-by: LFC <990479+MichaelScofield@users.noreply.github.com >
* chore: refactor try_acquire
Signed-off-by: jeremyhi <fengjiachun@gmail.com >
* chore: make size human readable
Signed-off-by: jeremyhi <fengjiachun@gmail.com >
---------
Signed-off-by: jeremyhi <fengjiachun@gmail.com >
Co-authored-by: LFC <990479+MichaelScofield@users.noreply.github.com >
2025-10-22 09:30:36 +00:00
Yingwen
a9c342b0f7
feat: support setting sst_format in table options ( #7068 )
...
* feat: add FormatType to support multi format in the future
Signed-off-by: evenyag <realevenyag@gmail.com >
* feat: add sst_format to RegionOptions
Signed-off-by: evenyag <realevenyag@gmail.com >
* feat: sets the sst_format based on RegionOptions
Signed-off-by: evenyag <realevenyag@gmail.com >
* feat: add sst_format to mito table options
Signed-off-by: evenyag <realevenyag@gmail.com >
* fix: fix RegionManifest deserialization without sst_format
Signed-off-by: evenyag <realevenyag@gmail.com >
* refactor: remove Parquet suffix from FormatType
Signed-off-by: evenyag <realevenyag@gmail.com >
* feat: prefer RegionOptions::sst_format in compactor/memtable builder
Signed-off-by: evenyag <realevenyag@gmail.com >
* refactor: rename enable_experimental_flat_format to
default_experimental_flat_format
Signed-off-by: evenyag <realevenyag@gmail.com >
* docs: update config.md
Signed-off-by: evenyag <realevenyag@gmail.com >
* style: fmt
Signed-off-by: evenyag <realevenyag@gmail.com >
* test: update manifest test
Signed-off-by: evenyag <realevenyag@gmail.com >
* chore: fix compiler errors, handle sst_format in remap_manifest
Signed-off-by: evenyag <realevenyag@gmail.com >
---------
Signed-off-by: evenyag <realevenyag@gmail.com >
2025-10-13 08:38:37 +00:00
LFC
8fe17d43d5
chore: update rust to nightly 2025-10-01 ( #7069 )
...
* chore: update rust to nightly 2025-10-01
Signed-off-by: luofucong <luofc@foxmail.com >
* chore: nix update
---------
Signed-off-by: luofucong <luofc@foxmail.com >
Co-authored-by: Ning Sun <sunning@greptime.com >
2025-10-11 07:30:52 +00:00
Ning Sun
aa84642afc
refactor!: remove pb_value to json conversion, keep json output consistent ( #7063 )
...
* refactor: remove pb_value to json
* chore: remove unused module
2025-10-10 07:09:20 +00:00
Sicong Hu
779865d389
feat: introduce IndexBuildTask for async index build ( #6927 )
...
* feat: add framework for asynchronous index building
Signed-off-by: SNC123 <sinhco@outlook.com >
* test: add unit tests for IndexBuildTask
Signed-off-by: SNC123 <sinhco@outlook.com >
* chore: clippy,format,fix-udeps
Signed-off-by: SNC123 <sinhco@outlook.com >
* fix: correct write cache logic in IndexBuildTask
Signed-off-by: SNC123 <sinhco@outlook.com >
* chore: clippy, resolve conflicts
Signed-off-by: SNC123 <sinhco@outlook.com >
* chore: resolve conflicts
Signed-off-by: SNC123 <sinhco@outlook.com >
* fix: apply review suggestions
Signed-off-by: SNC123 <sinhco@outlook.com >
* chore: resolve conflicts
Signed-off-by: SNC123 <sinhco@outlook.com >
* fix: clean up index files in aborted case
Signed-off-by: SNC123 <sinhco@outlook.com >
* refactor: move manifest update logic into IndexBuildTask
Signed-off-by: SNC123 <sinhco@outlook.com >
* fix: enhance check file logic and error handling
Signed-off-by: SNC123 <sinhco@outlook.com >
---------
Signed-off-by: SNC123 <sinhco@outlook.com >
2025-10-10 03:29:32 +00:00
shuiyisong
b24a55cea4
chore: rename the default ts column name to greptime_timestamp for influxdb line protocol ( #7046 )
...
* chore: rename influxdb ts column name to greptime_timestamp
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* fix: tests
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
---------
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
2025-10-09 02:14:11 +00:00
Ning Sun
660790148d
fix: various typos reported by CI ( #7047 )
...
* fix: various typos reported by CI
* fix: additional typo
2025-10-02 15:11:09 +00:00
zyy17
0717773f62
refactor!: add enable_read_cache config to support disable read cache explicitly ( #6834 )
...
* refactor: add `enable_read_cache` config to support disable read cache explicitly
Signed-off-by: zyy17 <zyylsxm@gmail.com >
* refactor: if `cache_path` is empty and `enable_read_cache` is true, set the default cache dir
Signed-off-by: zyy17 <zyylsxm@gmail.com >
* refactor: remove the unessary Option type for `ObjectStorageCacheConfig`
Signed-off-by: zyy17 <zyylsxm@gmail.com >
* refactor: sanitize cache config in `DatanodeOptions` and `StandaloneOptions`
Signed-off-by: zyy17 <zyylsxm@gmail.com >
* chore: code review comment
Signed-off-by: zyy17 <zyylsxm@gmail.com >
* chore: apply code review comments
Signed-off-by: zyy17 <zyylsxm@gmail.com >
---------
Signed-off-by: zyy17 <zyylsxm@gmail.com >
2025-09-26 09:44:12 +00:00
Ruihang Xia
0790835c77
feat!: improve greptime_identity pipeline behavior ( #6932 )
...
* flat by default, store array in string
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* expose max_nested_levels param, store string instead of error
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* remove flatten option
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* remove unused errors
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2025-09-25 15:28:28 +00:00
dennis zhuang
91a727790d
feat: supports permission mode for static user provider ( #7017 )
...
* feat: supports permission mode for static user provider
Signed-off-by: Dennis Zhuang <killme2008@gmail.com >
* chore: style
Signed-off-by: Dennis Zhuang <killme2008@gmail.com >
* fix: comment
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
---------
Signed-off-by: Dennis Zhuang <killme2008@gmail.com >
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
2025-09-25 03:45:31 +00:00
Yingwen
b8e0c49cb4
feat: add an flag to enable the experimental flat format ( #6976 )
...
* feat: add enable_experimental_flat_format flag to enable flat format
Signed-off-by: evenyag <realevenyag@gmail.com >
* refactor: extract build_scan_input for CompactionSstReaderBuilder
Signed-off-by: evenyag <realevenyag@gmail.com >
* chore: add compact memtable cost to flush metrics
Signed-off-by: evenyag <realevenyag@gmail.com >
* feat: Sets compact dispatcher for bulk memtable
Signed-off-by: evenyag <realevenyag@gmail.com >
* feat: Cast dictionary to target type in FlatProjectionMapper
Signed-off-by: evenyag <realevenyag@gmail.com >
* fix: add time index to FlatProjectionMapper::batch_schema
Signed-off-by: evenyag <realevenyag@gmail.com >
* chore: update config toml
Signed-off-by: evenyag <realevenyag@gmail.com >
* fix: pass flat_format to ProjectionMapper in CompactionSstReaderBuilder
Signed-off-by: evenyag <realevenyag@gmail.com >
---------
Signed-off-by: evenyag <realevenyag@gmail.com >
2025-09-16 09:33:12 +00:00
shuiyisong
ac051af201
feat(pipeline): generate create table sql from pipeline config ( #6930 )
...
* chore: add expr_to_create function using cc and polish
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* feat: add get pipeline create table
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* chore: update test_expr_to_create
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* fix: column extension
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* chore: add message hint for variant table name
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* chore: add message hint for existing table
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* test: create table for pipeline
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* chore: update comment
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* chore: rename to query pipeline ddl
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
---------
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
2025-09-09 02:47:51 +00:00
Ruihang Xia
c9377e7c5a
build: bump rust edition to 2024 ( #6920 )
...
* bump edition
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* format
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* gen keyword
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* lifetime and env var
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* one more gen fix
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* lifetime of temporaries in tail expressions
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* format again
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* clippy nested if
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* clippy let and return
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2025-09-08 02:37:18 +00:00
localhost
756856799f
refactor(pipeline)!: change dispatch table name format ( #6901 )
...
* chore(breaking): change dispatch table name format
* chore: fix test
2025-09-03 13:47:40 +00:00
Yingwen
ab96703d8f
chore: enlarge max file limit to 384 ( #6868 )
...
chore: enlarge max concurrent files to 384
Signed-off-by: evenyag <realevenyag@gmail.com >
2025-09-01 09:26:20 +00:00
discord9
bacd9c7d15
feat: add event ts to region manifest ( #6751 )
...
* feat: add event ts to region manifest
Signed-off-by: discord9 <discord9@163.com >
delete files
Signed-off-by: discord9 <discord9@163.com >
chore: clippy
Signed-off-by: discord9 <discord9@163.com >
lower concurrency
Signed-off-by: discord9 <discord9@163.com >
feat: gc use delta manifest to get expel time
Signed-off-by: discord9 <discord9@163.com >
docs: terminalogy
Signed-off-by: discord9 <discord9@163.com >
refactor: some advices from review
Signed-off-by: discord9 <discord9@163.com >
feat: manifest add removed files field
Signed-off-by: discord9 <discord9@163.com >
feat(WIP): add remove time in manifest
Signed-off-by: discord9 <discord9@163.com >
wip: more config
Signed-off-by: discord9 <discord9@163.com >
feat: manifest uodate removed files
Signed-off-by: discord9 <discord9@163.com >
test: add remove file opts field
Signed-off-by: discord9 <discord9@163.com >
test: fix test
Signed-off-by: discord9 <discord9@163.com >
chore: delete gc.rs
Signed-off-by: discord9 <discord9@163.com >
* feat: proper option name
Signed-off-by: discord9 <discord9@163.com >
* refactor: per review
Signed-off-by: discord9 <discord9@163.com >
* test: update manifest size
Signed-off-by: discord9 <discord9@163.com >
* test: fix eq
Signed-off-by: discord9 <discord9@163.com >
* refactor: some per review
Signed-off-by: discord9 <discord9@163.com >
* refactor: per review
Signed-off-by: discord9 <discord9@163.com >
* refactor: more per review
Signed-off-by: discord9 <discord9@163.com >
* test: update manifest size
Signed-off-by: discord9 <discord9@163.com >
* test: update config
Signed-off-by: discord9 <discord9@163.com >
* feat: keep count 0 means only use ttl
Signed-off-by: discord9 <discord9@163.com >
---------
Signed-off-by: discord9 <discord9@163.com >
2025-08-28 09:08:18 +00:00
Ning Sun
69eed2c3fa
feat: only show prometheus logical tables for __name__ values query ( #6814 )
...
feat: only show prometheus logical tables for __name__ query
Signed-off-by: Ning Sun <sunning@greptime.com >
2025-08-25 15:04:42 +00:00
Ning Sun
48572d18a8
feat: name label regex matcher in label values api ( #6799 )
...
* test: add failing test for #6791
* test: add support for = and =~
* fix: lint
* fix: code merge issue
Signed-off-by: Ning Sun <sunning@greptime.com >
---------
Signed-off-by: Ning Sun <sunning@greptime.com >
2025-08-25 08:48:53 +00:00
Ning Sun
68ac37461b
feat: add limit to label value api ( #6795 )
...
* feat: add limit to label value api
Signed-off-by: Ning Sun <sunning@greptime.com >
* feat: limit for special labels
Signed-off-by: Ning Sun <sunning@greptime.com >
---------
Signed-off-by: Ning Sun <sunning@greptime.com >
2025-08-23 06:23:51 +00:00
LFC
f9d2a89a0c
chore: update datafusion family ( #6675 )
...
* chore: update datafusion family
Signed-off-by: luofucong <luofc@foxmail.com >
* fix ci
Signed-off-by: luofucong <luofc@foxmail.com >
* use official otel-arrow-rust
Signed-off-by: luofucong <luofc@foxmail.com >
* rebase
Signed-off-by: luofucong <luofc@foxmail.com >
* use the official orc-rust
Signed-off-by: luofucong <luofc@foxmail.com >
* resolve PR comments
Signed-off-by: luofucong <luofc@foxmail.com >
* remove the empty lines
Signed-off-by: luofucong <luofc@foxmail.com >
* try following PR comments
Signed-off-by: luofucong <luofc@foxmail.com >
---------
Signed-off-by: luofucong <luofc@foxmail.com >
2025-08-15 12:41:49 +00:00
sunheyi
d03f85287e
feat: mysql add prepared_stmt_cache_capacity ( #6639 )
...
* feat: your clear and concise commit message
Signed-off-by: sunheyi <1061867552@qq.com >
* fix error
Signed-off-by: sunheyi <1061867552@qq.com >
* add param
Signed-off-by: sunheyi <1061867552@qq.com >
* fix
Signed-off-by: sunheyi <1061867552@qq.com >
* fix doc error
Signed-off-by: sunheyi <1061867552@qq.com >
---------
Signed-off-by: sunheyi <1061867552@qq.com >
2025-08-14 08:19:10 +00:00
zyy17
777da35b0d
refactor: unify the event recorder ( #6689 )
...
* refactor: unify the event recorder
Signed-off-by: zyy17 <zyylsxm@gmail.com >
* refactor: add `table_name()` in `Event` trait
Signed-off-by: zyy17 <zyylsxm@gmail.com >
* chore: add `slow_query_options` in `Instance`
Signed-off-by: zyy17 <zyylsxm@gmail.com >
* refactor: add `EventHandlerOptions` and `options()` in `EventHandler` trait
Signed-off-by: zyy17 <zyylsxm@gmail.com >
* chore: add `aggregate_events_by_type()` and support log mode of slow query
Signed-off-by: zyy17 <zyylsxm@gmail.com >
* chore: polish the code
Signed-off-by: zyy17 <zyylsxm@gmail.com >
* fix: clippy errors
Signed-off-by: zyy17 <zyylsxm@gmail.com >
* chore: support to set ttl by using extension of query context
Signed-off-by: zyy17 <zyylsxm@gmail.com >
* chore: refine the configs fields
Signed-off-by: zyy17 <zyylsxm@gmail.com >
* fix: sqlness test errors
Signed-off-by: zyy17 <zyylsxm@gmail.com >
* refactor: use `Duration` type instead of `String` for ttl fields
Signed-off-by: zyy17 <zyylsxm@gmail.com >
* refactor: use pre-allocation for building RowInsertRequests
Signed-off-by: zyy17 <zyylsxm@gmail.com >
* chore: fix clippy errors
Signed-off-by: zyy17 <zyylsxm@gmail.com >
* refactor: code review
Signed-off-by: zyy17 <zyylsxm@gmail.com >
* chore: fix integration errors
Signed-off-by: zyy17 <zyylsxm@gmail.com >
* refactor: polish code for `group_events_by_type()` and `build_row_inserts_request()`, also add the unit tests
Signed-off-by: zyy17 <zyylsxm@gmail.com >
* chore: refine comments
---------
Signed-off-by: zyy17 <zyylsxm@gmail.com >
2025-08-12 18:26:12 +00:00
Ruihang Xia
0781adaa3d
feat: new HTTP API for formatting SQL ( #6691 )
...
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2025-08-09 07:39:41 +00:00
LFC
253d89b5cc
feat: able to set read preference to flownode ( #6696 )
...
fix: correctly compare the opened follower regions in startup
Signed-off-by: luofucong <luofc@foxmail.com >
2025-08-08 09:08:09 +00:00
localhost
3a2f5413e0
chore: add and/or for log query ( #6681 )
...
* chore: add and/or for log query
* chore: remove impl From<Vec<ColumnFilters>> for Filters
2025-08-08 08:48:03 +00:00
zyy17
3a9f0220b5
fix: unable to record slow query ( #6590 )
...
* refactor: add process manager for prometheus query
Signed-off-by: zyy17 <zyylsxm@gmail.com >
* refactor: modify `register_query()` API to accept parsed statement(`catalog::process_manager::QueryStatement`)
Signed-off-by: zyy17 <zyylsxm@gmail.com >
* refactor: add the slow query timer in the `Tikcet` of ProcessManager
Signed-off-by: zyy17 <zyylsxm@gmail.com >
* test: add integration tests
Signed-off-by: zyy17 <zyylsxm@gmail.com >
* refactor: add process manager in `do_exec_plan()`
Signed-off-by: zyy17 <zyylsxm@gmail.com >
* tests: add `test_postgres_slow_query` integration test
Signed-off-by: zyy17 <zyylsxm@gmail.com >
* chore: polish the code
Signed-off-by: zyy17 <zyylsxm@gmail.com >
* refactor: create a query ticket and slow query timer if the statement is a query in `query_statement()`
Signed-off-by: zyy17 <zyylsxm@gmail.com >
* fix: sqlness errors
Signed-off-by: zyy17 <zyylsxm@gmail.com >
---------
Signed-off-by: zyy17 <zyylsxm@gmail.com >
2025-08-06 03:35:12 +00:00
Ning Sun
29e0092468
feat: schema/database support for label_values ( #6631 )
...
* feat: initial support for __schema__ in label values
* feat: filter database with matches
* refactor: skip unnecessary check
* fix: resolve schema matcher in label values
* test: add a test case for table not exists
* refactor: add matchop check on db label
* chore: merge main
2025-08-04 11:56:10 +00:00
Yingwen
280024d7f8
feat: Add option to limit the files reading simultaneously ( #6635 )
...
* feat: limits the max number of files to scan at the same time
Signed-off-by: evenyag <realevenyag@gmail.com >
* feat: make max_concurrent_scan_files configurable
Signed-off-by: evenyag <realevenyag@gmail.com >
* feat: reduce concurrent scan files to 128
Signed-off-by: evenyag <realevenyag@gmail.com >
* docs: update config example
Signed-off-by: evenyag <realevenyag@gmail.com >
* test: add test for max_concurrent_scan_files
Signed-off-by: evenyag <realevenyag@gmail.com >
* style: fix clippy
Signed-off-by: evenyag <realevenyag@gmail.com >
* test: update config test
Signed-off-by: evenyag <realevenyag@gmail.com >
---------
Signed-off-by: evenyag <realevenyag@gmail.com >
2025-08-04 07:18:58 +00:00
Ruihang Xia
572e29b158
feat: support tls for pg backend ( #6611 )
...
* load tls
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* impl tls
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* pass options
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* implement require mode
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* clean up
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update config
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix clippy
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* default to prefer
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update example config
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* adjust example config
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* handle client cert and key properly
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* implement verify_ca and verify_full
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update integration test for config api
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* change config name and default mode
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2025-08-04 00:41:08 +00:00
Ruihang Xia
9817eb934d
feat: support __schema__ and __database__ in Prom Remote Read ( #6610 )
...
* feat: support __schema__ and __database__ in Prom remote R/W
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix integration test
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* revert remote write changes
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* check matcher type
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2025-08-03 07:09:44 +00:00
shuiyisong
9e2f793b04
chore(otlp_metric): update metric and label naming ( #6624 )
...
* chore: update otlp metrics & labels naming
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* fix: typo and test
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* Update src/session/src/protocol_ctx.rs
* chore: add test cases for normalizing functions
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
---------
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
Co-authored-by: Ning Sun <classicning@gmail.com >
2025-08-01 08:17:12 +00:00
Yingwen
9527e0df2f
feat: HTTP API to activate/deactive heap prof (activate by default) ( #6593 )
...
* feat: add HTTP API to activate/deactivate heap profiling
Signed-off-by: evenyag <realevenyag@gmail.com >
* feat: add HTTP API to get profiling status
Signed-off-by: evenyag <realevenyag@gmail.com >
* feat: enable heap prof by default
Signed-off-by: evenyag <realevenyag@gmail.com >
* build: add "prof:true,prof_active:false" as default env to dockerfiles
Signed-off-by: evenyag <realevenyag@gmail.com >
* feat: activate heap profiling after log initialization
Signed-off-by: evenyag <realevenyag@gmail.com >
* feat: add memory options to control whether to activate profiling
Signed-off-by: evenyag <realevenyag@gmail.com >
* docs: update docs
Signed-off-by: evenyag <realevenyag@gmail.com >
* chore: fmt toml
Signed-off-by: evenyag <realevenyag@gmail.com >
* test: fix config test
Signed-off-by: evenyag <realevenyag@gmail.com >
* docs: usage of new api
Signed-off-by: evenyag <realevenyag@gmail.com >
* chore: log profile after version
Signed-off-by: evenyag <realevenyag@gmail.com >
* docs: update how to docs
Signed-off-by: evenyag <realevenyag@gmail.com >
* docs: fix how to docs
Signed-off-by: evenyag <realevenyag@gmail.com >
---------
Signed-off-by: evenyag <realevenyag@gmail.com >
2025-08-01 03:24:56 +00:00
shuiyisong
51dc393371
chore(otlp_metric): support attr list in header opts ( #6617 )
...
* chore: support attr list in OTLP metrics
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* chore: fix cr issue
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
---------
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
2025-07-31 08:54:45 +00:00
shuiyisong
2b4fb2f32a
refactor(otlp_metric): make otlp metric compatible with promql ( #6543 )
...
* chore: tmp save
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* chore: minor update
* chore: remove metric metadata and introduce shared attrs
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* chore: replace . with _ in metric name
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* chore: minor update & fix tests
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* chore: add legacy mode param to otlp metrics
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* chore: update test
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* chore: update test & fix
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* chore: add automatically legacy check for otlp metrics
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* chore: fix clippy
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* fix: typos
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* chore: insert table options in compat mode & add test
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* fix: check table options consistency
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* chore: update test and add comments
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* chore: minor tags update
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* chore: minor update about scope labeling
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* chore: update opts using header & update test
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* chore: minor code refactor
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* chore: fix cr issue
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
---------
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
2025-07-30 11:20:03 +00:00
discord9
8fef177575
feat: fallback when failed to push down using DistPlanner ( #6574 )
...
* test: fix fallback testcase
Signed-off-by: discord9 <discord9@163.com >
* add metric
Signed-off-by: discord9 <discord9@163.com >
* feat: fallback add to config variable
Signed-off-by: discord9 <discord9@163.com >
* feat: set in var&set in hint
Signed-off-by: discord9 <discord9@163.com >
* chore: update test
Signed-off-by: discord9 <discord9@163.com >
* feat: also in toml config
Signed-off-by: discord9 <discord9@163.com >
* fix test
Signed-off-by: discord9 <discord9@163.com >
* docs: comment about setting from different source
Signed-off-by: discord9 <discord9@163.com >
---------
Signed-off-by: discord9 <discord9@163.com >
2025-07-29 04:37:00 +00:00
Zhenchi
2298227e0c
refactor: refactor partition mod to use PartitionExpr instead of PartitionDef ( #6554 )
...
* refactor: refactor partition mod to use PartitionExpr instead of PartitionDef
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix snafu
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* Puts expression into PbPartition
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* address comments
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix compile
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* update proto
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* add serde test
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* add serde test
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
---------
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
2025-07-23 03:51:28 +00:00
discord9
bbc9f3ea1e
refactor: expose flow batching mode constants to config ( #6442 )
...
* refactor: make flow batching mode constant to configs
Signed-off-by: discord9 <discord9@163.com >
* docs: config docs
Signed-off-by: discord9 <discord9@163.com >
* docs: update code comment
Signed-off-by: discord9 <discord9@163.com >
* test: fix test_config_api
Signed-off-by: discord9 <discord9@163.com >
* feat: more batch opts
Signed-off-by: discord9 <discord9@163.com >
* fix after rebase
Signed-off-by: discord9 <discord9@163.com >
* chore: per review
Signed-off-by: discord9 <discord9@163.com >
* per review experimental options
Signed-off-by: discord9 <discord9@163.com >
---------
Signed-off-by: discord9 <discord9@163.com >
2025-07-16 08:05:20 +00:00
dennis zhuang
411eb768b1
feat: supports null reponse format for http API ( #6531 )
...
* feat: supports null reponse format for http API
Signed-off-by: Dennis Zhuang <killme2008@gmail.com >
* fix: license header and assertion
Signed-off-by: Dennis Zhuang <killme2008@gmail.com >
* chore: in seconds
Signed-off-by: Dennis Zhuang <killme2008@gmail.com >
---------
Signed-off-by: Dennis Zhuang <killme2008@gmail.com >
2025-07-16 03:46:39 +00:00
shuiyisong
582bcc3b14
feat(pipeline): filter processor ( #6502 )
...
* feat: add filter processor
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* test: add tests
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* chore: change target to list and use `in` and `not_in`
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* chore: rebase main and fix error
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
---------
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
2025-07-13 23:18:42 +00:00
Ning Sun
eeb061ca74
feat: allow float number literal in step ( #6483 )
...
* chore: allow float number literal as step
Signed-off-by: Ning Sun <sunning@greptime.com >
* chore: switch to released version of promql parser
Signed-off-by: Ning Sun <sunning@greptime.com >
---------
Signed-off-by: Ning Sun <sunning@greptime.com >
2025-07-09 03:09:09 +00:00
shuiyisong
f7282fde28
chore: sort range query return values ( #6474 )
...
* chore: sort range query return values
* chore: add comments
* chore: add is_sorted check
* fix: test
2025-07-09 02:27:12 +00:00
Zhenchi
599f289f59
feat: add granularity and false_positive_rate options for indexes ( #6416 )
...
* feat: add `granularity` and `false_positive_rate` options for indexes
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* address comments
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* upgrade proto
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
---------
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
2025-07-02 07:33:39 +00:00
shuiyisong
dec8c52b18
feat(pipeline): support Loki API ( #6390 )
...
* chore: use schema_info
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* refactor: abstract loki item generator
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* chore: introduce middle item
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* feat: introduce pipeline in loki api
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* test: add tests
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* chore: minor update
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* chore: minor update
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* chore: update prefix and test
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* chore: change recursion to loop
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* fix: cr issue
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
---------
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
2025-06-28 01:01:08 +00:00
dennis zhuang
944b4b3e49
feat: supports CsvWithNames and CsvWithNamesAndTypes formats ( #6384 )
...
* feat: supports CsvWithNames and CsvWithNamesAndTypes formats and object/array types
Signed-off-by: Dennis Zhuang <killme2008@gmail.com >
* test: added and fixed tests
Signed-off-by: Dennis Zhuang <killme2008@gmail.com >
* chore: fix test
Signed-off-by: Dennis Zhuang <killme2008@gmail.com >
* chore: remove comments
Signed-off-by: Dennis Zhuang <killme2008@gmail.com >
* test: add json type csv tests
Signed-off-by: Dennis Zhuang <killme2008@gmail.com >
* chore: remove comment
Co-authored-by: Yingwen <realevenyag@gmail.com >
---------
Signed-off-by: Dennis Zhuang <killme2008@gmail.com >
Co-authored-by: Yingwen <realevenyag@gmail.com >
2025-06-25 07:28:11 +00:00
zyy17
90a3894564
refactor: always write parent_span_id for otlp traces ingestion ( #6356 )
...
* refactor: always write `parent_span_id` for otlp traces ingestion
Signed-off-by: zyy17 <zyylsxm@gmail.com >
* refactor: support to write None value in row writer
Signed-off-by: zyy17 <zyylsxm@gmail.com >
---------
Signed-off-by: zyy17 <zyylsxm@gmail.com >
2025-06-23 11:36:57 +00:00
shuiyisong
7cd6be41ce
feat(pipeline): introduce pipeline doc version 2 for combine-transform ( #6360 )
...
* chore: init commit of pipeline doc version v2
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* chore: remove unused code
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* chore: remove unused code
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* chore: add test
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* chore: add test
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* chore: compatible with v1 to remain field in the map during transform
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* refactor: pipeline.exec_mut
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* fix: typo
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
* chore: change from v2 to 2 in version setting
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
---------
Signed-off-by: shuiyisong <xixing.sys@gmail.com >
2025-06-22 00:58:36 +00:00
rgidda
e026f766d2
feat(storage): Add skip_ssl_validation option for object storage HTTP client ( #6358 )
...
* feat(storage): Add skip_ssl_validation option for object storage HTTP client
Signed-off-by: rgidda <rgidda@hitachivantara.com >
* fix(test): Broken test case for - Add skip_ssl_validation option for object storage HTTP client
Signed-off-by: rgidda <rgidda@hitachivantara.com >
* fix: test
* fix: test
---------
Signed-off-by: rgidda <rgidda@hitachivantara.com >
Co-authored-by: rgidda <rgidda@hitachivantara.com >
Co-authored-by: dennis zhuang <killme2008@gmail.com >
2025-06-20 08:08:19 +00:00
