Ruihang Xia
f5cf25b0db
refactor: remove DfPlan wrapper ( #4733 )
...
* refactor: remove DfPlan wrapper
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* clean up
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* remove unused errors
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix test assertion
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2024-09-19 12:29:33 +00:00
Ning Sun
b741a7181b
feat: track channels with query context and w/rcu ( #4448 )
...
* feat: add source channel to meter recorders
* feat: provide channel for query context
* fix: testing and extension get for query context
* chore: revert cargo toml structure changes
* fix: querycontext modification for prometheus and pipeline
* chore: switch git dependency to main branches
* chore: remove TODO
* refactor: rename other to unknown
---------
Co-authored-by: shuiyisong <113876041+shuiyisong@users.noreply.github.com >
2024-07-31 07:30:50 +00:00
tison
285ffc5850
fix: build info should use build time env var ( #4343 )
...
* fix: build info should use build time env var
Signed-off-by: tison <wander4096@gmail.com >
* catch up
Signed-off-by: tison <wander4096@gmail.com >
* fixup lifetime
Signed-off-by: tison <wander4096@gmail.com >
* fixup
Signed-off-by: tison <wander4096@gmail.com >
* fix more
Signed-off-by: tison <wander4096@gmail.com >
---------
Signed-off-by: tison <wander4096@gmail.com >
2024-07-12 03:08:30 +00:00
Ning Sun
8399dcada3
refactor: use rwlock for modifiable session data ( #4232 )
...
* chore: update sqlness results
* refactor: use rwlock for modifiable data in session and querycontext
* chore: format toml
* refactor: use mutable_inner structure for mutable fields
* refactor: remove arc wrapper
2024-07-04 12:53:25 +00:00
Ning Sun
11cf9c827e
feat: dbeaver mysql compatibility, use statement and information_schema.tables ( #4218 )
...
* feat: add more placeholder field in information_schema.tables
* feat: make schema modifiable for use statement
* chore: add todo items
* fix: resolve lint issues after data type changes
* chore: update sqlness results
* refactor: patch for select database is no longer needed
* test: align tests and data types
* Apply suggestions from code review
Co-authored-by: dennis zhuang <killme2008@gmail.com >
* fix: use canonicalize_identifier for database name
* feat: add all columns for information_schema.tables
* test: remove vairables from sqlness results
* feat: add to_string impl for table options
---------
Co-authored-by: dennis zhuang <killme2008@gmail.com >
2024-07-03 01:31:13 +00:00
maco
494ce65729
feat: limiting the size of query results to Dashboard ( #3901 )
...
* feat: limiting the size of query results to Dashboard
* optimize code
* fix by cr
* fix integration tests error
* remove RequestSource::parse
* refactor: sql query params
* fix: unit test
---------
Co-authored-by: tison <wander4096@gmail.com >
2024-05-14 01:57:30 +00:00
irenjj
7a04bfe50a
feat: add strict mode to validate protocol strings ( #3638 )
...
* feat: add strict mode to validate protocol strings
* hotfix: fix test
* fix: fix return pair and test param
* test: add test for utf-8 validation
* fix: cargo check
* Update src/servers/src/prom_row_builder.rs
Co-authored-by: Eugene Tolbakov <ev.tolbakov@gmail.com >
* fix: fix param of without_strict_mode
* fix: change field name in HttpOptions
* fix: replace if else with match
* fix: replace all strict_mode with is_stirct_mode
* fix: fix test_config_api
* fix: fix bench, add vm handshake, catch error
---------
Co-authored-by: Eugene Tolbakov <ev.tolbakov@gmail.com >
Co-authored-by: tison <wander4096@gmail.com >
2024-04-15 07:53:48 +00:00
tison
883b7fce96
refactor: bundle the lightweight axum test client ( #3669 )
...
* refactor: bundle the lightweight axum test client
Signed-off-by: tison <wander4096@gmail.com >
* address comments
Signed-off-by: tison <wander4096@gmail.com >
---------
Signed-off-by: tison <wander4096@gmail.com >
2024-04-09 02:33:26 +00:00
x³u³
2ad0b24efa
fix: set http response chartset to utf-8 when using table format ( #3571 )
2024-03-25 03:13:01 +00:00
Lei, HUANG
86fb9d8ac7
refactor: remove redudant PromStoreProtocolHandler::write ( #3553 )
...
refactor: remove redudant PromStoreProtocolHandler::write API and rename PromStoreProtocolHandler::write_fast to write
2024-03-22 02:09:00 +00:00
tison
8b7a5aaa4a
refactor: handle error for http format ( #3548 )
...
* refactor: handle error for http format
Signed-off-by: tison <wander4096@gmail.com >
* finish format handling
Signed-off-by: tison <wander4096@gmail.com >
* simplify auth error
Signed-off-by: tison <wander4096@gmail.com >
* fix
Signed-off-by: tison <wander4096@gmail.com >
* clippy format
Signed-off-by: tison <wander4096@gmail.com >
* no longer set greptime-db-format on influxdb error
Signed-off-by: tison <wander4096@gmail.com >
---------
Signed-off-by: tison <wander4096@gmail.com >
2024-03-21 07:29:11 +00:00
shuiyisong
3acd5bfad0
chore: http header with metrics ( #3536 )
...
* chore: bring write cost to output
* chore: add write cost to greptimev1result
* chore: add metrics to influxdb write resp header
* chore: add metrics to prom store
* chore: add metrics to otlp
* chore: add debug log
* fix: prom remote read with output
* fix: prom queries don't output metrics header
* chore: extract header value
* chore: refactor code
* chore: fix cr issue
2024-03-18 11:21:19 +00:00
Eugene Tolbakov
aeca0d8e8a
feat(influxdb): add db query param support for v2 write api ( #3445 )
...
* feat(influxdb): add db query param support for v2 write api
* fix(influxdb): update authorize logic to get catalog and schema from query string
* fix(influxdb): address CR suggestions
* fix(influxdb): use the correct import
2024-03-08 08:17:57 +00:00
shuiyisong
a9d42f7b87
fix: add support for influxdb basic auth ( #3437 )
2024-03-06 03:56:25 +00:00
Lei, HUANG
02b18fbca1
feat: decode prom requests to grpc ( #3425 )
...
* hack: inline decode
* move to servers
* fix: samples lost
* add bench
* remove useless functions
* wip
* feat: remove object pools
* fix: minor issues
* fix: remove useless dep
* chore: rebase main
* format
* finish
* fix: format
* feat: introduce request pool
* try to fix license issue
* fix: clippy
* resolve comments
* fix:typo
* remove useless comments
2024-03-05 09:47:32 +00:00
tison
4c07606da6
refactor: put together HTTP headers ( #3337 )
...
* refactor: put together HTTP headers
Signed-off-by: tison <wander4096@gmail.com >
* do refactor
Signed-off-by: tison <wander4096@gmail.com >
* drop dirty commit
Signed-off-by: tison <wander4096@gmail.com >
* reduce changeset
Signed-off-by: tison <wander4096@gmail.com >
* fixup compilations
Signed-off-by: tison <wander4096@gmail.com >
* tidy files
Signed-off-by: tison <wander4096@gmail.com >
* drop common-api
Signed-off-by: tison <wander4096@gmail.com >
* fmt
Signed-off-by: tison <wander4096@gmail.com >
---------
Signed-off-by: tison <wander4096@gmail.com >
2024-02-21 09:51:10 +00:00
LFC
f81e37f508
refactor: make http server built flexibly ( #3225 )
...
* refactor: make http server built flexibly
* Apply suggestions from code review
Co-authored-by: JeremyHi <jiachun_feng@proton.me >
* fix: resolve PR comments
* Fix CI.
---------
Co-authored-by: JeremyHi <jiachun_feng@proton.me >
2024-01-24 03:45:08 +00:00
Ruihang Xia
31787f4bfd
feat!: switch prom remote write to metric engine ( #3198 )
...
* feat: switch prom remote write to metric engine
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* Apply suggestions from code review
Co-authored-by: dennis zhuang <killme2008@gmail.com >
* fix compile
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* read physical table name from url
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* remove physical table from header
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix merge error
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix format
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add with_metric_engine option to config remote write behavior
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* check parameter
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add specific config param
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* default with_metric_engine to true
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update UT
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: dennis zhuang <killme2008@gmail.com >
2024-01-22 14:48:28 +00:00
tison
316d843482
feat: support CSV format in sql HTTP API ( #3062 )
...
* chore: fix typo
Signed-off-by: tison <wander4096@gmail.com >
* add csv format
Signed-off-by: tison <wander4096@gmail.com >
* flatten response
Signed-off-by: tison <wander4096@gmail.com >
* more flatten response
Signed-off-by: tison <wander4096@gmail.com >
* add CSV format
Signed-off-by: tison <wander4096@gmail.com >
* format InfluxdbV1Response
Signed-off-by: tison <wander4096@gmail.com >
* format ErrorResponse
Signed-off-by: tison <wander4096@gmail.com >
* propagate ErrorResponse to InfluxdbV1Response
Signed-off-by: tison <wander4096@gmail.com >
* format GreptimedbV1Response
Signed-off-by: tison <wander4096@gmail.com >
* format CsvResponse
Signed-off-by: tison <wander4096@gmail.com >
* impl IntoResponse for QueryResponse
Signed-off-by: tison <wander4096@gmail.com >
* promql
Signed-off-by: tison <wander4096@gmail.com >
* sql
Signed-off-by: tison <wander4096@gmail.com >
* compile
Signed-off-by: tison <wander4096@gmail.com >
* fixup aide
Signed-off-by: tison <wander4096@gmail.com >
* clear debt
Signed-off-by: tison <wander4096@gmail.com >
* fixup UT test_recordbatches_conversion
Signed-off-by: tison <wander4096@gmail.com >
* fixup IT cases
Signed-off-by: tison <wander4096@gmail.com >
* fixup more IT cases
Signed-off-by: tison <wander4096@gmail.com >
* fixup test-integration cases
Signed-off-by: tison <wander4096@gmail.com >
* update comment
Signed-off-by: tison <wander4096@gmail.com >
* fixup deserialize and most query < 1ms
Signed-off-by: tison <wander4096@gmail.com >
* fixup auth tests
Signed-off-by: tison <wander4096@gmail.com >
* fixup tests
Signed-off-by: tison <wander4096@gmail.com >
* fixup and align X-GreptimeDB headers
Signed-off-by: tison <wander4096@gmail.com >
* fixup compile
Signed-off-by: tison <wander4096@gmail.com >
---------
Signed-off-by: tison <wander4096@gmail.com >
2024-01-08 10:54:27 +00:00
shuiyisong
5dba373ede
chore: return json body under http status 401 ( #2924 )
...
* chore: change auth_fn to function and return response with json body
* chore: move unsupported to debug level
* chore: add docs and tests
* chore: rebase and update test
2023-12-14 10:01:12 +00:00
JeremyHi
99dda93f0e
feat: sql with influxdb v1 result format ( #2917 )
...
* feat: sql with influxdb v1 result format
* chore: add unit tests
* feat: minor refactor
* chore: by comment
* chore; u128 to u64 since serde can't deser u128 in enum
* chore: by comment
* chore: apply suggestion
* chore: revert suggestion
* chore: try again
---------
Co-authored-by: dennis zhuang <killme2008@gmail.com >
2023-12-13 16:15:37 +00:00
Yingwen
06327fba1e
feat: improve http error message ( #2767 )
...
* feat: improve http error message
* feat: log http error
* style: fix clippy
* test: fix test
2023-11-17 04:03:30 +00:00
tison
0cd6dacb45
chore: multiple licenses fixes ( #2714 )
...
* chore: avoid license risk from akka
Signed-off-by: tison <wander4096@gmail.com >
* chore: LICENSE test is AS IS
Signed-off-by: tison <wander4096@gmail.com >
* ci: use hawkeye to pin in inceptionYear
Signed-off-by: tison <wander4096@gmail.com >
* add instruction for running license header apply
Signed-off-by: tison <wander4096@gmail.com >
---------
Signed-off-by: tison <wander4096@gmail.com >
2023-11-09 10:38:12 +00:00
WU Jingdi
180bc64cb0
feat: change metric crate from metrics to prometheus ( #2655 )
...
* feat: change metrics to prometheus
* chore: fix code advise
* chore: resolve merge conflict
* chore: fix code advise
2023-10-31 15:46:57 +00:00
Ning Sun
0fbde48655
feat: hide internal error and unknown error message from end user ( #2544 )
...
* feat: use fixed error message for unknown error
* feat: return fixed message for internal error as well
* chore: include status code in error message
* test: update tests for asserts of error message
* feat: change status code of some datafusion error
* fix: make CollectRecordbatch an query error
* test: update sqlness results
2023-10-23 03:07:35 +00:00
Baasit
346b57cf10
feat: row protocol support for opentsdb ( #2623 )
...
* feat: opentsdb row protocol
* fix: added commnets for num of rows and failure if output is not of affecetd rows
* fix: added extra 1 to number of columns
* fix: avoided cloning datapoints, took ownership instead
* fix: avoided cloning datapoints, took ownership instead
* fix: changed vecotr slice to vector
* fix: remove clone
* fix: combined datapoints and requests with zip instead of enumerating
---------
Co-authored-by: Ubuntu <ubuntu@ip-172-31-43-183.us-east-2.compute.internal >
2023-10-20 06:25:59 +00:00
shuiyisong
ee8d472aae
chore: tune return msg ( #2506 )
...
* chore: test return msg
* fix: test_child_error
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* chore: fix test
* chore: minor fix grpc return value
* chore: format return msg
* chore: use root error as return value
* chore: fix empty err display
* chore: iter through external error
* chore: remove err msg
* chore: remove unused field
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
2023-09-27 10:40:25 +00:00
JeremyHi
7310ec0bb3
chore: refactor options ( #2476 )
2023-09-24 02:12:33 +00:00
shuiyisong
20f4f7971a
refactor: remove source and location in snafu display ( #2428 )
...
* refactor: remove source pt 1
* refactor: remove source pt 2
* refactor: remove source pt 3
* refactor: remove location pt 1
* refactor: remove location pt 2
* chore: remove rustc files
* chore: fix error case
* chore: fix test
* chore: fix test
* chore: fix cr issue
Co-authored-by: fys <40801205+fengys1996@users.noreply.github.com >
---------
Co-authored-by: fys <40801205+fengys1996@users.noreply.github.com >
2023-09-21 02:55:24 +00:00
LFC
fe5679e77e
refactor: remove table ident ( #2368 )
...
* refactor:
1. remove TableIdent, use TableId directly
2. use the latest greptime-proto
3. independently invalidate table id cache and table name cache
* rebase
* fix: resolve PR comments
* fix: resolve PR comments
2023-09-15 05:14:40 +00:00
shuiyisong
f16f58266e
refactor: query_ctx from http middleware ( #2253 )
...
* chore: change userinfo to query_ctx in http handler
* chore: minor change
* chore: move prometheus http to http mod
* chore: fix uni test:
* chore: add back schema check
* chore: minor change
* chore: remove clone
2023-08-25 09:36:33 +00:00
JeremyHi
033b650d0d
feat: row write protocol ( #2189 )
...
* feat: datanode's row insrter
* refactor: ExprFactory
* feat: row inserter in standalon mode
* chore: minor refactor
* feat: influxdb line protocol's row protocol
* chore: minor refactor
* improve: avoid to use too many string
* no longer async
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
* chore: do not check empty data
* chore: by review comment
* chore: by comment
* chore: by review comment
* chore: by review comment
---------
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
2023-08-19 13:08:44 +00:00
shuiyisong
7f51141ed0
refactor: auth crate ( #2148 )
...
* chore: move user_info to auth crate
* chore: temp commit before resolving tests compile error
* chore: fix compile issue
* chore: minor fix
* chore: tmp save
* chore: change user_info to trait
* chore: minor change & use auth result user info in pg session setup
* chore: add as_any to user_info
* chore: rename user_info
* chore: remove ice file
* chore: add permission checker
* chore: add grpc permission check
* chore: add session spawn user_info to query_ctx
* chore: minor update
* chore: add permission checker to sql handler & temp save
* chore: add permission checker to prometheus handler
* chore: add permission checker to opentsdb handler
* chore: add permission checker to other handlers
* chore: add test
* chore: add user_info setting on http entrance
* chore: fix toml
* chore: remove box in permission req
* chore: cr issue
* chore: cr issue
2023-08-14 02:51:26 +00:00
gongzhengyang
ce0f909cac
perf: change current schema and catalog to borrow, clone only necessary ( #2116 )
...
perf: change current schema and catalog to borrow, clone only when necessary
Co-authored-by: gongzhengyang <gongzhengyang@bolean.com.cn >
2023-08-08 12:48:24 +00:00
Eugene Tolbakov
6811acb314
fix(status_endpoint): add default value for hostname ( #1972 )
...
* fix(status_endpoint): add default value for hostname
* fix: adjust according to clippy suggestions
* fix: adjust according to CR suggestions
2023-07-17 11:55:11 +00:00
Eugene Tolbakov
674bfd85c7
chore(prom)!: rename prometheus(remote storage) to prom-store and promql(HTTP server) to prometheus ( #1931 )
...
* chore(prom): rename prometheus(remote storage) to prom-store and promql(HTTP server) to prometheus
* chore: apply clippy suggestions
* chore: adjust format according to rustfmt
2023-07-12 14:47:09 +08:00
Eugene Tolbakov
fc850c9988
feat(config-endpoint): add initial implementation ( #1896 )
...
* feat(config-endpoint): add initial implementation
* feat: add initial handler implementation
* fix: apply clippy suggestions, use axum response instead of string
* feat: address CR suggestions
* fix: minor adjustments in formatting
* fix: add a test
* feat: add to_toml_string method to options
* fix: adjust the assertion for the integration test
* fix: adjust expected indents
* fix: adjust assertion for the integration test
* fix: improve according to clippy
2023-07-11 11:08:32 +08:00
Lei, HUANG
f287d3115b
chore: replace result assertions ( #1840 )
...
* s/assert!\((.*)\.is_ok\(\)\);/\1.unwrap\(\);/g
* s/assert!\((.*)\.is_some\(\)\);/\1.unwrap\(\);/g
2023-06-27 19:14:48 +08:00
LFC
fcff66e039
chore: deny unused results ( #1825 )
...
* chore: deny unused results
* rebase
2023-06-27 15:33:53 +08:00
Eugene Tolbakov
3b91fc2c64
feat: add initial implementation for status endpoint ( #1789 )
...
* feat: add initial implementation for status endpoint
* feat(status_endpoint): add more data to response
* feat(status_endpoint): use build data env vars
* feat(status_endpoint): add simple test
* fix(status_endpoint): adjust the toml indentation
2023-06-21 10:50:08 +08:00
dennis zhuang
30472cebae
feat: prepare supports caching logical plan and infering param types ( #1776 )
...
* feat: change do_describe function signature
* feat: infer param type and cache logical plan for msyql prepared statments
* fix: convert_value
* fix: forgot helper
* chore: comments
* fix: typo
* test: add more tests and test date, datatime in mysql
* chore: fix CR comments
* chore: add location
* chore: by CR comments
* Update tests-integration/tests/sql.rs
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
* chore: remove the trace
---------
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
2023-06-20 04:07:28 +00:00
LFC
5004cf6d9a
feat: make grpc insert requests in a batch ( #1687 )
...
* feat: make Prometheus remote write in a batch
* rebase
* fix: resolve PR comments
* fix: resolve PR comments
* fix: resolve PR comments
2023-06-02 09:06:48 +00:00
dennis zhuang
7c55783e53
feat!: reorganize the storage layout ( #1609 )
...
* feat: adds data_home to DataOptions
* refactor: split out object store stuffs from datanode instance
* feat: move data_home into FileConfig
* refactor: object storage layers
* feat: adds datanode path to procedure paths
* feat: temp commit
* refactor: clean code
* fix: forgot files
* fix: forgot files
* Update src/common/test-util/src/ports.rs
Co-authored-by: Yingwen <realevenyag@gmail.com >
* Update tests/runner/src/env.rs
Co-authored-by: Yingwen <realevenyag@gmail.com >
* fix: compile error
* chore: cr comments
* fix: dependencies order in cargo
* fix: data path in test
---------
Co-authored-by: Yingwen <realevenyag@gmail.com >
2023-05-23 13:58:26 +08:00
localhost
34c7f78861
chore: add configurator to http server ( #1488 )
...
* chore: add configurator params to start server fun
* chore: update plugins type
---------
Co-authored-by: paomian <qtang@greptime.com >
2023-05-08 10:55:03 +00:00
Lei, HUANG
fb9978e95d
refactor: catalog ( #1454 )
...
* wip
* add schema_async
* remove CatalogList
* remove catalog provider and schema provider
* fix
* fix: rename table
* fix: sqlness
* fix: ignore tonic error metadata
* fix: table engine name
* feat: rename catalog_async to catalog
* respect engine name in table regional value when deregistering tables
* fix: CR
2023-04-26 08:36:40 +00:00
localhost
a2b262ebc0
chore: add http metrics server in datanode node when greptime start in distributed mode ( #1256 )
...
* chore: add http metrics server in datanode node when greptime start in distributed mode
* chore: add some docs and license
* chore: change metrics_addr to resolve address already in use error
* chore add metrics for meta service
* chore: replace metrics exporter http server from hyper to axum
* chore: format
* fix: datanode mode branching error
* fix: sqlness test address already in use and start metrics in defualt config
* chore: change metrics location
* chore: use builder pattern to builder httpserver
* chore: remove useless debug_assert macro in httpserver builder
* chore: resolve conflicting build error
* chore: format code
2023-03-31 18:37:52 +08:00
Lei, HUANG
17eb99bc52
feat: allow manual table flush through HTTP API ( #1184 )
2023-03-15 20:15:34 +08:00
LFC
604c20a83d
refactor: remove the SQL execution interfaces in Datanode ( #1135 )
...
* refactor: remove the SQL execution interfaces in Datanode
2023-03-13 18:45:30 +08:00
shuiyisong
dc50095af3
fix: use catalog from connection ( #1099 )
...
* fix: using schema instead of full database
* fix: using schema instead of full database
* fix: using schema instead of full database
* chore: add debug log
* chore: remove debug log
* chore: remove debug log
* chore: fix cr
2023-03-01 10:34:57 +08:00
LFC
11d45e2918
refactor: upgrade DataFusion, Arrow and Sqlparser ( #1074 )
...
* refactor: upgrade DataFusion, Arrow and Sqlparser
* fix: resolve PR comments
2023-02-27 22:20:08 +08:00
