LFC
87d32fc255
fix: show tables too slow cherry pick ( #7244 )
...
v0.12.1
fix: `show tables` is too slow under large tables
Signed-off-by: luofucong <luofc@foxmail.com >
2025-11-18 12:29:40 +00:00
LFC
503585ba42
ci: update github runner on old branch ( #7249 )
...
* ci: update github runner (ubuntu-20.04 -> ubuntu-22.04)
Signed-off-by: luofucong <luofc@foxmail.com >
2025-11-18 19:52:03 +08:00
Lei, HUANG
ee2a7a5f10
fix: check if memtable is empty by stats ( #5989 )
...
fix/checking-memtable-empty-and-stats:
- **Refactor timestamp updates**: Simplified timestamp range updates in `PartitionTreeMemtable` and `TimeSeriesMemtable` by replacing `update_timestamp_range` with `fetch_max` and `fetch_min` methods for `max_timestamp` and `min_timestamp`.
- Affected files: `partition_tree.rs`, `time_series.rs`
- **Remove unused code**: Deleted the `update_timestamp_range` method from `WriteMetrics` and removed unnecessary imports.
- Affected file: `stats.rs`
- **Optimize memtable filtering**: Streamlined the check for empty memtables in `ScanRegion` by directly using `time_range`.
- Affected file: `scan_region.rs`
(cherry picked from commit 1a517ec8ac
2025-06-04 11:36:42 +08:00
LFC
f6f617d667
feat: submit node's cpu cores number to metasrv in heartbeat ( #5571 )
...
* feat: submit node's cpu cores number to metasrv in heartbeat
* update greptime-proto dep
2025-02-20 03:55:18 +00:00
Ruihang Xia
e8788088a8
feat(log-query): implement the first part of log query expr ( #5548 )
...
* feat(log-query): implement the first part of log query expr
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix clippy
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2025-02-19 18:25:41 +00:00
shuiyisong
53b25c04a2
chore: support Loki's structured metadata for ingestion ( #5541 )
...
* chore: support loki's structured metadata
* test: update test
* chore: revert some code change
* chore: address CR comment
2025-02-19 16:44:26 +00:00
dennis zhuang
62a8b8b9dc
feat(promql): supports sort, sort_desc etc. functions ( #5542 )
...
* feat(promql): supports sort, sort_desc etc. functions
* chore: fix toml format and tests
* chore: update deps
Co-authored-by: Weny Xu <wenymedia@gmail.com >
* chore: remove fixme
* fix: cargo lock
* chore: style
---------
Co-authored-by: Weny Xu <wenymedia@gmail.com >
2025-02-19 13:13:49 +00:00
Weny Xu
c8bdeaaa6a
fix(promql-planner): update ctx field columns of OR operator ( #5556 )
...
* fix(promql-planner): update ctx field columns of OR operator
* test: add sqlness test
2025-02-19 11:18:58 +00:00
Ning Sun
81da18e5df
refactor: use global type alias for pipeline input ( #5568 )
...
* refactor: use global type alias for pipeline input
* fmt: reformat
2025-02-19 10:41:33 +00:00
Weny Xu
7c65fddb30
fix(promql-planner): correct AND/UNLESS operator behavior ( #5557 )
...
* fix(promql-planner): keep field column in left input for AND operator
* test: add sqlness test
* fix: fix unless operator
2025-02-19 09:07:39 +00:00
Zhenchi
421e38c481
feat: allow purging a given puffin file in staging area ( #5558 )
...
* feat: purge a given puffin file in staging area
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* polish log
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* ttl set to 2d
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* feat: expose staging_ttl to index config
* fix test
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* use `invalidate_entries_if` instead of maintaining map
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* run_pending_tasks after purging
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
---------
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
Co-authored-by: evenyag <realevenyag@gmail.com >
2025-02-19 08:58:30 +00:00
Weny Xu
aada5c1706
fix(promql-planner): remove le tag in ctx ( #5560 )
...
* fix(promql-planner): remove le tag in ctx
* test: add sqlness test
* chore: apply suggestions from CR
2025-02-19 03:51:27 +00:00
yihong
aa8f119bbb
chore: format all toml files ( #5529 )
...
fix: format some cargo files
Signed-off-by: yihong0618 <zouzou0208@gmail.com >
2025-02-18 12:09:01 +00:00
ZonaHe
19a6d15849
feat: update dashboard to v0.7.10 ( #5562 )
...
Co-authored-by: ZonaHex <ZonaHex@users.noreply.github.com >
2025-02-18 12:06:22 +00:00
liyang
073aaefe65
chore: improve grafana dashboard ( #5559 )
2025-02-18 11:36:27 +00:00
Yingwen
77223a0f3e
fix: window sort support alias time index ( #5543 )
...
* fix: use alias expr to check commutativity
* chore: debug sort
* feat: consider alias in window sort optimizer
* test: sqlness test
* test: update sqlness result
2025-02-18 10:35:43 +00:00
Ruihang Xia
4ef038d098
fix: correct promql behavior on nonexistent columns ( #5547 )
...
* Revert "fix(promql): ignore filters for non-existent labels (#5519 )"
This reverts commit 33a2485f54waynestxia@gmail.com >
* state safety
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2025-02-17 18:43:50 +00:00
jeremyhi
deb9520970
fix: information_schema.cluster_info be covered by the same id ( #5555 )
...
* fix: information_schema.cluster_info be coverd by the same id
* chore: by comment
2025-02-17 11:51:02 +00:00
Yingwen
6bba5e0afa
feat: collect stager metrics ( #5553 )
...
* feat: collect stager metrics
* Apply suggestions from code review
Co-authored-by: Zhenchi <zhongzc_arch@outlook.com >
* Update src/mito2/src/metrics.rs
---------
Co-authored-by: Weny Xu <wenymedia@gmail.com >
Co-authored-by: Zhenchi <zhongzc_arch@outlook.com >
2025-02-17 07:09:15 +00:00
Ruihang Xia
f359eeb667
feat(log-query): support specifying exclusive/inclusive for between filter ( #5546 )
...
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2025-02-17 04:40:47 +00:00
liyang
009dbad581
ci: don't push nightly latest image ( #5551 )
...
* ci: don't push nightly latest image
* add push release latest image
2025-02-17 04:34:49 +00:00
liyang
a2047b096c
ci: use s5cmd upload artifacts ( #5550 )
2025-02-17 02:57:13 +00:00
Ruihang Xia
6e8b1ba004
feat: drop noneffective regex filter ( #5544 )
...
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2025-02-15 04:20:26 +00:00
Ruihang Xia
7fc935c61c
feat!: support alter skipping index ( #5538 )
...
* feat: support alter skipping index
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update test results
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* cargo fmt
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update sqlness result
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* finalize
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2025-02-14 18:43:21 +00:00
discord9
1e6d2fb1fa
feat: add snapshot seqs field to query context ( #5477 )
...
* TODO: snapshot read
* feat: RegionEngine get last seq
* feat: query context snapshot
* chore: use new proto
* feat: get_region_seqs in region engine
* chore: typo
* chore: toml
* feat: make snapshots modifiable
* feat: add hint for snapshot read
* chore: some typo
* refactor: remove hint as not used
* fix: use commited seqs
* refactor: remove sequences variant on RegionRequest
* refactor: per review
* chore: rebase solve conflict
* refactor: rm unused key
* chore: per review
* chore: per review
2025-02-14 09:07:48 +00:00
Ruihang Xia
0d19e8f089
fix: promql join operation won't consider time index ( #5535 )
...
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: Weny Xu <wenymedia@gmail.com >
2025-02-14 08:21:05 +00:00
Weny Xu
c56106b883
perf: optimize table alteration speed in metric engine ( #5526 )
...
* feat(metric-engine): introduce batch alter request handling
* refactor: minor refactor
* refactor: push down filter to mito
* chore: apply suggestions from CR
2025-02-14 08:11:48 +00:00
Yohan Wal
edb040dea3
refactor: refactor pg kvbackend impl in preparation for other rds kvbackend ( #5494 )
...
* refactor: unify rds kvbackend impl
* fix: licence header
* refactor: use unique sql template set
* fix: fix deps
* chore: apply optimization patch
* chore: apply optimization patch(2)
* chore: follow review comments
2025-02-14 08:10:09 +00:00
Ruihang Xia
7bbc87b3c0
feat(promql): add series count metrics ( #5534 )
...
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: Weny Xu <wenymedia@gmail.com >
2025-02-14 07:49:28 +00:00
Zhenchi
858dae7b23
feat: add stager nofitier to collect metrics ( #5530 )
...
* feat: add stager nofitier to collect metrics
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* apply prev commit
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* remove dup size
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* add load cost
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
---------
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
2025-02-14 07:49:26 +00:00
Weny Xu
33a2485f54
fix(promql): ignore filters for non-existent labels ( #5519 )
...
* fix(promql): ignore filters for non-existent labels
* chore: add comments
* test: add sqlness test
2025-02-14 06:40:15 +00:00
zyy17
8ebf454bc1
fix(jaeger): return error when no tracing table ( #5539 )
...
fix: return error when no tracing table
2025-02-14 06:20:56 +00:00
Ning Sun
f5b9ade6df
chore: add section marker for extenal dependencies ( #5536 )
...
* chore: add section marker for extenal dependencies
* chore: update cargo.lock
* Update Cargo.toml
Co-authored-by: shuiyisong <113876041+shuiyisong@users.noreply.github.com >
* chore: update meter-core
---------
Co-authored-by: shuiyisong <113876041+shuiyisong@users.noreply.github.com >
2025-02-14 06:16:57 +00:00
Ruihang Xia
9c1834accd
fix: old typo ( #5532 )
...
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2025-02-14 02:18:43 +00:00
Yingwen
918517d221
feat: window sort supports where on fields and time index ( #5527 )
...
* feat: handle filter for window sort
* test: sqlness filter test for window sort
* test: add test on tag column filter
* test: test for filter on ts
* test: update sqlness test
2025-02-14 01:38:15 +00:00
liyang
92d9e81a9f
ci: use the repository variable to pass to image-name ( #5517 )
...
Co-authored-by: Yingwen <realevenyag@gmail.com >
2025-02-13 18:14:49 +00:00
yihong
224b1d15cd
chore: use the same version of chrono-tz ( #5523 )
...
* fix: use the same version of chrono-tz
Signed-off-by: yihong0618 <zouzou0208@gmail.com >
* fix: address comments
Signed-off-by: yihong0618 <zouzou0208@gmail.com >
---------
Signed-off-by: yihong0618 <zouzou0208@gmail.com >
2025-02-13 17:23:29 +00:00
Yingwen
b4d5393080
feat: speed up read/write cache and stager eviction ( #5531 )
...
* feat: change cache policy for file cache
* feat: file cache run pending task after put
* feat: run pending task in put_dir
* feat: run pending task after stager recovered
* feat: purge recycle bin periodically
* feat: use lru policy for read cache
2025-02-13 17:13:24 +00:00
Weny Xu
73c29bb482
fix(promql): unescape matcher values ( #5521 )
...
* fix(promql): unescape matcher values
* test: add sqlness tests
* chore: apply suggestions from CR
* feat: use unescaper
2025-02-13 09:42:25 +00:00
Ning Sun
198ee87675
feat: alias database matcher for promql ( #5522 )
...
* feat: provide an alias db matcher for promql
* refactor: rename __db__ to __database__
* chore: fix sqlness test
2025-02-13 08:37:37 +00:00
jeremyhi
02af9dd21a
refactor!: remove datetime type ( #5506 )
...
* feat remove datetime type
* chore: fix unit test
* chore: add column test
* refactor: move create and alter validation to one place
* chore: minor refactor ut
* refactor: rename expr_factory to expr_helper
* chore: remove unnecessary args
2025-02-13 08:01:16 +00:00
Weny Xu
bb97f1bf16
perf: optimize table creation speed in metric engine ( #5503 )
...
* feat(metric-engine): introduce batch create request handling
* chore: remove unused code
* test: add more tests
* chore: remove unused error
* chore: apply suggestions from CR
2025-02-13 07:39:04 +00:00
yihong
fbd5316fdb
perf: better performance for LastNonNullIter close #5229 about 10x times faster ( #5518 )
...
* fix: better performance for LastNonNullIter close #LastNonNullIter
Signed-off-by: yihong0618 <zouzou0208@gmail.com >
* fix: address comments
Signed-off-by: yihong0618 <zouzou0208@gmail.com >
* fix: add Safety comments for the unwrap
Signed-off-by: yihong0618 <zouzou0208@gmail.com >
---------
Signed-off-by: yihong0618 <zouzou0208@gmail.com >
2025-02-13 05:14:39 +00:00
Weny Xu
63d5a69a31
fix(query_range): skip data field on errors ( #5520 )
...
* fix: skip serializing PrometheusResponse when None
* fix: fix unit test
* chore: clippy
2025-02-13 04:32:24 +00:00
zyy17
954310f917
feat: implement Jaeger query APIs ( #5452 )
...
* feat: implement jaeger query api
* test: add some unit tests
* test: add integration tests for jaeger query APIs
* refactor: parse tags from url parameters
* refactor: support to query traces by tags
* refactor: add limit parameter
* refactor: add jaeger query api metrics
* chore: add some comment docs and default limit value
* test: add more unit tests
* docs: add jaeger options in config docs
* refactor: code review
* wip
* refactor: use datafusion's dataframe APIs to query traces
* refactor: code review
* chore: format test cases
* refactor: add check_schema()
* chore: fix clippy errors and rename function name
* refactor: throw error when covert start_time and duration error
* chore: modify incorrect request type name
* chore: remove unecessary serde rename
* refactor: add some important comments
* refactor: add SPAN_KIND_PREFIX
* refactor: code review
2025-02-12 23:36:38 +00:00
zyy17
58c6274bf6
fix: use fixed tonistiigi/binfmt:qemu-v7.0.0-28 image version instead of latest version to avoid segmentation fault ( #5516 )
...
fix: use fixed tonistiigi/binfmt:qemu-v7.0.0-28 image version instead of latest version to avoid segmentation fault
Co-authored-by: Yingwen <realevenyag@gmail.com >
2025-02-12 19:29:49 +00:00
Ning Sun
46947fd1de
ci: docbot requires pull_request_target ( #5514 )
2025-02-12 09:46:04 +00:00
Weny Xu
44fffdec8b
refactor: refactor region server request handling ( #5504 )
...
* refactor: refactor region server requests handling
* chore: apply suggestions from CR
2025-02-12 08:34:42 +00:00
Ruihang Xia
8026b1d72c
feat!: unify all index creation grammars ( #5486 )
...
* column options
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* handle table constrain
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update test assertions
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* change inverted index table constrain usage
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update sqlness result
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* don't create inverted index for pk on alter table
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* remove remaining pk-as-inverted-index
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* more inverted index magic
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update sqlness result again
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix clippy
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* Update src/sql/src/statements.rs
Co-authored-by: jeremyhi <jiachun_feng@proton.me >
* drop support for index def in table constrain
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: jeremyhi <jiachun_feng@proton.me >
2025-02-12 06:54:09 +00:00
Ruihang Xia
e22aa819be
feat: support server-side keep-alive for mysql and pg protocols ( #5496 )
...
* feat: support server-side keep-alive for mysql and pg protocols
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update config.md
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update config to use humantime for keep-alive configuration
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* chore: Update socket2 dependency
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2025-02-11 19:22:10 +00:00
