rust/greptimedb
1
0
Fork 0
mirror of https://github.com/GreptimeTeam/greptimedb.git synced 2026-05-26 01:40:36 +00:00
Code Issues Packages Projects Releases Wiki Activity
3,960 Commits 134 Branches 254 Tags
747b71bf74b4ba5ead90b8a0278db16d9d63993e
Commit Graph

725 Commits

Author SHA1 Message Date
Ruihang Xia
747b71bf74 feat: add query engine options (#5895) 
* feat: add query engine options

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

* update example

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

---------

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>
 2025-04-14 13:12:37 +00:00
Ning Sun
2ebe005e3c refactor: simplify tls key read code (#5856) 2025-04-09 08:50:43 +00:00
Weny Xu
746b4e2369 refactor: improve error code handling in status code conversion (#5851) 
* refactor: improve error code handling in status code conversion

* chore: apply suggestions from CR

* fix: only hanlde client side thrown error

* feat: introduce `DeadlineExceeded`

* fix: exclude Code::Unknown from retry conditions
 2025-04-09 07:58:23 +00:00
LFC
311727939d chore: update datafusion family (#5814) 2025-04-09 02:20:55 +00:00
Ruihang Xia
c26e165887 refactor: check and fix super import (#5846) 
* refactor: check and fix super import

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

* add to makefile

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

* change dir

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

---------

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>
 2025-04-08 11:48:52 +00:00
zyy17
ee4fe9d273 refactor: improve performance for Jaeger APIs (#5838) 
* refactor: improve jaeger '/api/services' performance by adding the trace services table

* chore: refine some logic

* chore: compatible v0

* test: add integration test

* chore: expand default limit from 100 to 2000

* test: fix integration test

* refactor: make trace service table configurable

* refactor: use a timestamp(2100-01-01 00:00:00) as large as possible

* refactor: use '<trace_table>_services' as trace services table name
 2025-04-08 02:28:06 +00:00
zyy17
cf1440fc32 refactor: add time range for jager get operations API (#5791) 
* refactor: add default time range for jager get operations API

* refactor: use desc order for timestamp colomn

* chore: modify http header name
 2025-04-07 09:07:31 +00:00
fys
7b48ef1e97 chore: remove patch.crates-io for rustls (#5832) 
* chore: remove patch.crates-io for rustls

* enable default-rustls-ring feature for mysql_sync

* fix: build error

* add comment

* update comment
 2025-04-07 07:51:50 +00:00
Ning Sun
f2907bb009 refactor!: make pipeline a required parameter when ingesting trace (#5828) 
* feat: make pipeline a required header for trace

* test: add test case without pipeline
 2025-04-07 06:18:17 +00:00
shuiyisong
054056fcbb refactor: remove prom store write dispatch (#5812) 
* refactor: remove prom store remote write dispatch pattern

* chore: ref XIX-22
 2025-04-02 04:35:28 +00:00
Weny Xu
4ef9afd8d8 feat: introduce read preference (#5783) 
* feat: introduce read preference

* feat: introduce `RegionQueryHandlerFactory`

* feat: extract ReadPreference from http header

* test: add more tests

* chore: apply suggestions from CR

* chore: apply suggestions from CR
 2025-04-01 09:17:01 +00:00
shuiyisong
f9221e9e66 perf: introduce simd_json for parsing ndjson (#5794) 
* perf: introduce simd_json for parsing ndjson

* fix: some tests

* fix: some tests

* fix: es test case

* chore: use `as_bytes_mut()`

* chore: remove unnecessary `to_string`

* chore: add safety comment
 2025-04-01 08:17:26 +00:00
shuiyisong
bef45ed0e8 feat(pipeline): support table name suffix templating in pipeline (#5775) 
* chore: add table name template in pipeline yaml

* chore: implement apply function and add simple test

* chore: add comment and integration test

* chore: minor update

* fix: typos

* chore: change to table suffix

* chore: update comment and test

* chore: change name to table_suffix
 2025-03-28 18:12:46 +00:00
Yingwen
737558ef53 fix: support __name__ matcher in label values (#5773) 2025-03-28 02:18:59 +00:00
shuiyisong
2b4ed43692 chore: accept table options in auto create table from hints (#5776) 
chore: accept table options in auto create table from hint
 2025-03-27 08:17:27 +00:00
fys
2b2ea5bf72 chore: upgrade some dependencies (#5777) 
* chore: upgrade some dependencies

* chore: upgrade some dependencies

* fix: cr

* fix: ci

* fix: test

* fix: cargo fmt
 2025-03-27 02:48:44 +00:00
shuiyisong
f13a43647a chore: remove Transformer trait (#5772) 
* chore: remove transformer trait

* chore: remove unnecessory generic
 2025-03-26 02:53:30 +00:00
discord9
c4ac242c69 fix: properly give placeholder types (#5760) 
* fix: properly give placeholder types

* chore: update sqlness
 2025-03-24 08:41:32 +00:00
shuiyisong
c77ce958a3 chore: support custom time index selector for identity pipeline (#5750) 
* chore: minor refactor

* chore: minor refactor

* chore: support custom ts for identity pipeline

* chore: fix clippy

* chore: minor refactor & update tests

* chore: use ref on identity pipeline param
 2025-03-24 04:27:22 +00:00
shuiyisong
2431cd3bdf chore: merge error files under pipeline crate (#5738) 2025-03-19 09:55:51 +00:00
discord9
cd730e0486 fix: mysql prepare limit&offset param (#5734) 
* fix: prepare limit&offset param

* test: sqlness

* chore: per review

* chore: per review
 2025-03-19 07:49:26 +00:00
zyy17
a19441bed8 refactor: remove trace id from primary key in opentelemetry_traces table (#5733) 
* refactor: remove trace id in primary key

* refactor: remove trace id in primary key in v0 model

* refactor: add span id in v1

* fix: integration test
 2025-03-19 06:17:58 +00:00
discord9
46070958c9 fix: mysql prepare bool value (#5732) 2025-03-18 10:50:45 +00:00
Ning Sun
1ab4ddab8d feat: update pipeline header name to x-greptime-pipeline-name (#5710) 
* feat: update pipeline header name to x-greptime-pipeline-name

* refactor: update string_value_from_header
 2025-03-18 02:39:54 +00:00
Ning Sun
9e63018198 feat: disable http timeout (#5721) 
* feat: update to disable http timeout by default

* feat: make http timeout default to 0

* test: correct test case

* chore: generate new config doc

* test: correct tests
 2025-03-18 01:18:56 +00:00
localhost
1586732d20 chore: add some method for log query handler (#5685) 
* chore: add some method for log query handler

* chore: make clippy happy

* chore: add some method for log query handler

* Update src/frontend/src/instance/logs.rs

Co-authored-by: shuiyisong <113876041+shuiyisong@users.noreply.github.com>

---------

Co-authored-by: shuiyisong <113876041+shuiyisong@users.noreply.github.com>
 2025-03-17 18:36:43 +00:00
Ning Sun
2260782c12 refactor: update jaeger api implementation for new trace modeling (#5655) 
* refactor: update jaeger api implementation

* test: add tests for v1 data model

* feat: customize trace table name

* fix: update column requirements to use Column type instead of String

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

* fix: lint fix

* refactor: accumulate resource attributes for v1

* fix: add empty check for additional string

* feat: add table option to mark data model version

* fix: do not overwrite all tags

* feat: use table option to mark table data model version and process accordingly

* chore: update comments to reflect query changes

* feat: use header for jaeger table name

* feat: update index for service_name, drop index for span_name

---------

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>
Co-authored-by: Ruihang Xia <waynestxia@gmail.com>
Co-authored-by: zyy17 <zyylsxm@gmail.com>
 2025-03-17 07:31:32 +00:00
Ning Sun
dc76571166 feat: move default data path from /tmp to current directory (#5719) 2025-03-16 09:57:46 +00:00
shuiyisong
3e17f8c426 chore: use Bytes instead of string in bulk ingestion (#5717) 
chore: use bytes instead of string in bulk log ingestion
 2025-03-14 09:31:35 +00:00
Ning Sun
8fa2fdfc42 feat: make empty parent_span_id null for v1 (#5690) 2025-03-13 07:48:15 +00:00
shuiyisong
e0ff701e51 chore: support application/x-ndjson for log ingest (#5697) 
chore: support ndjson content type
 2025-03-13 04:29:22 +00:00
Lin Yihai
2cbf51d0be refactor!: Remove Value::DateTime and ValueRef::DateTime. (#5616) 
* refactor: Remove Value::DateTime and ValueRef::DateTime

* fix: don't panic if arrow cast field.

* fix: map `ColumnDataType::Datetime` to `ConcreteDataType::timestamp_microsecond_datatype`

* fix: Map `ValueData::DatetimeValue` correctly.

* refactor: Replace `datetime` with `timestamp_micro_second`
 2025-03-11 07:03:27 +00:00
Weny Xu
0bd322a078 perf(prom): optimize label values query (#5653) 
perf: optimize label values query
 2025-03-10 13:20:47 +00:00
ZonaHe
3a83c33a48 feat: update dashboard to v0.8.0 (#5666) 
Co-authored-by: sunchanglong <sunchanglong@users.noreply.github.com>
Co-authored-by: Ning Sun <sunng@protonmail.com>
 2025-03-07 19:47:02 +00:00
shuiyisong
c8db4b286d fix: use DateTime instead of NaiveDateTime (#5669) 
chore: use datetime instead of naivedatetime
 2025-03-07 07:41:59 +00:00
shuiyisong
448e588fa7 chore: improve /v1/jaeger/api/trace/{trace_id}'s resp (#5663) 
* chore: improve jaeger trace api resp

* chore: fix timestamp type

* chore: fix timestamp type

* chore: complete more fields

* chore: change to microseconds

* chore: add empty check & span status code

* chore: minor update

* chore: update test
 2025-03-07 04:31:42 +00:00
Ning Sun
37f8341963 feat: opentelemetry trace new data modeling (#5622) 
* feat: include trace v1 encoding

* feat: add trace ingestion in inserter

* feat: add partition rules and index for trace_id

* chore: format

* chore: fmt

* fix: issue introduced with merge

* feat: adjust index and add integration test for v1

* refactor: remove comment key

* fix: update default value of skip index granularity

* fix: update default value of skip index granularity

* refactor: rename some functions

* feat: remove skipping index from span_id

* refactor: made span_id part of primary key for potential dedup purpose

* feat: move the special attribute resource_attribute.service.name to top level

---------

Co-authored-by: shuiyisong <113876041+shuiyisong@users.noreply.github.com>
 2025-03-05 04:08:52 +00:00
Ning Sun
c9d70e0e28 refactor: add pipeline concept to OTLP traces and remove OTLP over gRPC (#5605) 2025-02-27 14:01:45 +00:00
Weny Xu
c1d18d9980 fix(prom): preserve the order of series in PromQueryResult (#5601) 
fix(prom): keep the order of tags
 2025-02-26 13:40:09 +00:00
ZonaHe
538875abee feat: update dashboard to v0.7.11 (#5597) 
Co-authored-by: sunchanglong <sunchanglong@users.noreply.github.com>
 2025-02-26 07:57:59 +00:00
Weny Xu
1d8c9c1843 feat: enable gzip for prometheus query handlers and ignore NaN values in prometheus response (#5576) 
* feat: enable gzip for prometheus query handlers and ignore nan values in prometheus response

* Apply suggestions from code review

Co-authored-by: shuiyisong <113876041+shuiyisong@users.noreply.github.com>

---------

Co-authored-by: shuiyisong <113876041+shuiyisong@users.noreply.github.com>
 2025-02-20 11:34:32 +00:00
shuiyisong
53b25c04a2 chore: support Loki's structured metadata for ingestion (#5541) 
* chore: support loki's structured metadata

* test: update test

* chore: revert some code change

* chore: address CR comment
 2025-02-19 16:44:26 +00:00
Ning Sun
81da18e5df refactor: use global type alias for pipeline input (#5568) 
* refactor: use global type alias for pipeline input

* fmt: reformat
 2025-02-19 10:41:33 +00:00
yihong
aa8f119bbb chore: format all toml files (#5529) 
fix: format some cargo files

Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2025-02-18 12:09:01 +00:00
ZonaHe
19a6d15849 feat: update dashboard to v0.7.10 (#5562) 
Co-authored-by: ZonaHex <ZonaHex@users.noreply.github.com>
 2025-02-18 12:06:22 +00:00
zyy17
8ebf454bc1 fix(jaeger): return error when no tracing table (#5539) 
fix: return error when no tracing table
 2025-02-14 06:20:56 +00:00
Weny Xu
73c29bb482 fix(promql): unescape matcher values (#5521) 
* fix(promql): unescape matcher values

* test: add sqlness tests

* chore: apply suggestions from CR

* feat: use unescaper
 2025-02-13 09:42:25 +00:00
Weny Xu
63d5a69a31 fix(query_range): skip data field on errors (#5520) 
* fix: skip serializing PrometheusResponse when None

* fix: fix unit test

* chore: clippy
 2025-02-13 04:32:24 +00:00
zyy17
954310f917 feat: implement Jaeger query APIs (#5452) 
* feat: implement jaeger query api

* test: add some unit tests

* test: add integration tests for jaeger query APIs

* refactor: parse tags from url parameters

* refactor: support to query traces by tags

* refactor: add limit parameter

* refactor: add jaeger query api metrics

* chore: add some comment docs and default limit value

* test: add more unit tests

* docs: add jaeger options in config docs

* refactor: code review

* wip

* refactor: use datafusion's dataframe APIs to query traces

* refactor: code review

* chore: format test cases

* refactor: add check_schema()

* chore: fix clippy errors and rename function name

* refactor: throw error when covert start_time and duration error

* chore: modify incorrect request type name

* chore: remove unecessary serde rename

* refactor: add some important comments

* refactor: add SPAN_KIND_PREFIX

* refactor: code review
 2025-02-12 23:36:38 +00:00
Ruihang Xia
e22aa819be feat: support server-side keep-alive for mysql and pg protocols (#5496) 
* feat: support server-side keep-alive for mysql and pg protocols

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

* update config.md

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

* update config to use humantime for keep-alive configuration

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

* chore: Update socket2 dependency

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

---------

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>
 2025-02-11 19:22:10 +00:00