shuiyisong
5dba373ede
chore: return json body under http status 401 ( #2924 )
...
* chore: change auth_fn to function and return response with json body
* chore: move unsupported to debug level
* chore: add docs and tests
* chore: rebase and update test
2023-12-14 10:01:12 +00:00
JeremyHi
99dda93f0e
feat: sql with influxdb v1 result format ( #2917 )
...
* feat: sql with influxdb v1 result format
* chore: add unit tests
* feat: minor refactor
* chore: by comment
* chore; u128 to u64 since serde can't deser u128 in enum
* chore: by comment
* chore: apply suggestion
* chore: revert suggestion
* chore: try again
---------
Co-authored-by: dennis zhuang <killme2008@gmail.com >
2023-12-13 16:15:37 +00:00
Yingwen
06327fba1e
feat: improve http error message ( #2767 )
...
* feat: improve http error message
* feat: log http error
* style: fix clippy
* test: fix test
2023-11-17 04:03:30 +00:00
tison
0cd6dacb45
chore: multiple licenses fixes ( #2714 )
...
* chore: avoid license risk from akka
Signed-off-by: tison <wander4096@gmail.com >
* chore: LICENSE test is AS IS
Signed-off-by: tison <wander4096@gmail.com >
* ci: use hawkeye to pin in inceptionYear
Signed-off-by: tison <wander4096@gmail.com >
* add instruction for running license header apply
Signed-off-by: tison <wander4096@gmail.com >
---------
Signed-off-by: tison <wander4096@gmail.com >
2023-11-09 10:38:12 +00:00
WU Jingdi
180bc64cb0
feat: change metric crate from metrics to prometheus ( #2655 )
...
* feat: change metrics to prometheus
* chore: fix code advise
* chore: resolve merge conflict
* chore: fix code advise
2023-10-31 15:46:57 +00:00
Ning Sun
0fbde48655
feat: hide internal error and unknown error message from end user ( #2544 )
...
* feat: use fixed error message for unknown error
* feat: return fixed message for internal error as well
* chore: include status code in error message
* test: update tests for asserts of error message
* feat: change status code of some datafusion error
* fix: make CollectRecordbatch an query error
* test: update sqlness results
2023-10-23 03:07:35 +00:00
Baasit
346b57cf10
feat: row protocol support for opentsdb ( #2623 )
...
* feat: opentsdb row protocol
* fix: added commnets for num of rows and failure if output is not of affecetd rows
* fix: added extra 1 to number of columns
* fix: avoided cloning datapoints, took ownership instead
* fix: avoided cloning datapoints, took ownership instead
* fix: changed vecotr slice to vector
* fix: remove clone
* fix: combined datapoints and requests with zip instead of enumerating
---------
Co-authored-by: Ubuntu <ubuntu@ip-172-31-43-183.us-east-2.compute.internal >
2023-10-20 06:25:59 +00:00
shuiyisong
ee8d472aae
chore: tune return msg ( #2506 )
...
* chore: test return msg
* fix: test_child_error
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* chore: fix test
* chore: minor fix grpc return value
* chore: format return msg
* chore: use root error as return value
* chore: fix empty err display
* chore: iter through external error
* chore: remove err msg
* chore: remove unused field
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
2023-09-27 10:40:25 +00:00
JeremyHi
7310ec0bb3
chore: refactor options ( #2476 )
2023-09-24 02:12:33 +00:00
shuiyisong
20f4f7971a
refactor: remove source and location in snafu display ( #2428 )
...
* refactor: remove source pt 1
* refactor: remove source pt 2
* refactor: remove source pt 3
* refactor: remove location pt 1
* refactor: remove location pt 2
* chore: remove rustc files
* chore: fix error case
* chore: fix test
* chore: fix test
* chore: fix cr issue
Co-authored-by: fys <40801205+fengys1996@users.noreply.github.com >
---------
Co-authored-by: fys <40801205+fengys1996@users.noreply.github.com >
2023-09-21 02:55:24 +00:00
LFC
fe5679e77e
refactor: remove table ident ( #2368 )
...
* refactor:
1. remove TableIdent, use TableId directly
2. use the latest greptime-proto
3. independently invalidate table id cache and table name cache
* rebase
* fix: resolve PR comments
* fix: resolve PR comments
2023-09-15 05:14:40 +00:00
shuiyisong
f16f58266e
refactor: query_ctx from http middleware ( #2253 )
...
* chore: change userinfo to query_ctx in http handler
* chore: minor change
* chore: move prometheus http to http mod
* chore: fix uni test:
* chore: add back schema check
* chore: minor change
* chore: remove clone
2023-08-25 09:36:33 +00:00
JeremyHi
033b650d0d
feat: row write protocol ( #2189 )
...
* feat: datanode's row insrter
* refactor: ExprFactory
* feat: row inserter in standalon mode
* chore: minor refactor
* feat: influxdb line protocol's row protocol
* chore: minor refactor
* improve: avoid to use too many string
* no longer async
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
* chore: do not check empty data
* chore: by review comment
* chore: by comment
* chore: by review comment
* chore: by review comment
---------
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
2023-08-19 13:08:44 +00:00
shuiyisong
7f51141ed0
refactor: auth crate ( #2148 )
...
* chore: move user_info to auth crate
* chore: temp commit before resolving tests compile error
* chore: fix compile issue
* chore: minor fix
* chore: tmp save
* chore: change user_info to trait
* chore: minor change & use auth result user info in pg session setup
* chore: add as_any to user_info
* chore: rename user_info
* chore: remove ice file
* chore: add permission checker
* chore: add grpc permission check
* chore: add session spawn user_info to query_ctx
* chore: minor update
* chore: add permission checker to sql handler & temp save
* chore: add permission checker to prometheus handler
* chore: add permission checker to opentsdb handler
* chore: add permission checker to other handlers
* chore: add test
* chore: add user_info setting on http entrance
* chore: fix toml
* chore: remove box in permission req
* chore: cr issue
* chore: cr issue
2023-08-14 02:51:26 +00:00
gongzhengyang
ce0f909cac
perf: change current schema and catalog to borrow, clone only necessary ( #2116 )
...
perf: change current schema and catalog to borrow, clone only when necessary
Co-authored-by: gongzhengyang <gongzhengyang@bolean.com.cn >
2023-08-08 12:48:24 +00:00
Eugene Tolbakov
6811acb314
fix(status_endpoint): add default value for hostname ( #1972 )
...
* fix(status_endpoint): add default value for hostname
* fix: adjust according to clippy suggestions
* fix: adjust according to CR suggestions
2023-07-17 11:55:11 +00:00
Eugene Tolbakov
674bfd85c7
chore(prom)!: rename prometheus(remote storage) to prom-store and promql(HTTP server) to prometheus ( #1931 )
...
* chore(prom): rename prometheus(remote storage) to prom-store and promql(HTTP server) to prometheus
* chore: apply clippy suggestions
* chore: adjust format according to rustfmt
2023-07-12 14:47:09 +08:00
Eugene Tolbakov
fc850c9988
feat(config-endpoint): add initial implementation ( #1896 )
...
* feat(config-endpoint): add initial implementation
* feat: add initial handler implementation
* fix: apply clippy suggestions, use axum response instead of string
* feat: address CR suggestions
* fix: minor adjustments in formatting
* fix: add a test
* feat: add to_toml_string method to options
* fix: adjust the assertion for the integration test
* fix: adjust expected indents
* fix: adjust assertion for the integration test
* fix: improve according to clippy
2023-07-11 11:08:32 +08:00
Lei, HUANG
f287d3115b
chore: replace result assertions ( #1840 )
...
* s/assert!\((.*)\.is_ok\(\)\);/\1.unwrap\(\);/g
* s/assert!\((.*)\.is_some\(\)\);/\1.unwrap\(\);/g
2023-06-27 19:14:48 +08:00
LFC
fcff66e039
chore: deny unused results ( #1825 )
...
* chore: deny unused results
* rebase
2023-06-27 15:33:53 +08:00
Eugene Tolbakov
3b91fc2c64
feat: add initial implementation for status endpoint ( #1789 )
...
* feat: add initial implementation for status endpoint
* feat(status_endpoint): add more data to response
* feat(status_endpoint): use build data env vars
* feat(status_endpoint): add simple test
* fix(status_endpoint): adjust the toml indentation
2023-06-21 10:50:08 +08:00
dennis zhuang
30472cebae
feat: prepare supports caching logical plan and infering param types ( #1776 )
...
* feat: change do_describe function signature
* feat: infer param type and cache logical plan for msyql prepared statments
* fix: convert_value
* fix: forgot helper
* chore: comments
* fix: typo
* test: add more tests and test date, datatime in mysql
* chore: fix CR comments
* chore: add location
* chore: by CR comments
* Update tests-integration/tests/sql.rs
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
* chore: remove the trace
---------
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
2023-06-20 04:07:28 +00:00
LFC
5004cf6d9a
feat: make grpc insert requests in a batch ( #1687 )
...
* feat: make Prometheus remote write in a batch
* rebase
* fix: resolve PR comments
* fix: resolve PR comments
* fix: resolve PR comments
2023-06-02 09:06:48 +00:00
dennis zhuang
7c55783e53
feat!: reorganize the storage layout ( #1609 )
...
* feat: adds data_home to DataOptions
* refactor: split out object store stuffs from datanode instance
* feat: move data_home into FileConfig
* refactor: object storage layers
* feat: adds datanode path to procedure paths
* feat: temp commit
* refactor: clean code
* fix: forgot files
* fix: forgot files
* Update src/common/test-util/src/ports.rs
Co-authored-by: Yingwen <realevenyag@gmail.com >
* Update tests/runner/src/env.rs
Co-authored-by: Yingwen <realevenyag@gmail.com >
* fix: compile error
* chore: cr comments
* fix: dependencies order in cargo
* fix: data path in test
---------
Co-authored-by: Yingwen <realevenyag@gmail.com >
2023-05-23 13:58:26 +08:00
localhost
34c7f78861
chore: add configurator to http server ( #1488 )
...
* chore: add configurator params to start server fun
* chore: update plugins type
---------
Co-authored-by: paomian <qtang@greptime.com >
2023-05-08 10:55:03 +00:00
Lei, HUANG
fb9978e95d
refactor: catalog ( #1454 )
...
* wip
* add schema_async
* remove CatalogList
* remove catalog provider and schema provider
* fix
* fix: rename table
* fix: sqlness
* fix: ignore tonic error metadata
* fix: table engine name
* feat: rename catalog_async to catalog
* respect engine name in table regional value when deregistering tables
* fix: CR
2023-04-26 08:36:40 +00:00
localhost
a2b262ebc0
chore: add http metrics server in datanode node when greptime start in distributed mode ( #1256 )
...
* chore: add http metrics server in datanode node when greptime start in distributed mode
* chore: add some docs and license
* chore: change metrics_addr to resolve address already in use error
* chore add metrics for meta service
* chore: replace metrics exporter http server from hyper to axum
* chore: format
* fix: datanode mode branching error
* fix: sqlness test address already in use and start metrics in defualt config
* chore: change metrics location
* chore: use builder pattern to builder httpserver
* chore: remove useless debug_assert macro in httpserver builder
* chore: resolve conflicting build error
* chore: format code
2023-03-31 18:37:52 +08:00
Lei, HUANG
17eb99bc52
feat: allow manual table flush through HTTP API ( #1184 )
2023-03-15 20:15:34 +08:00
LFC
604c20a83d
refactor: remove the SQL execution interfaces in Datanode ( #1135 )
...
* refactor: remove the SQL execution interfaces in Datanode
2023-03-13 18:45:30 +08:00
shuiyisong
dc50095af3
fix: use catalog from connection ( #1099 )
...
* fix: using schema instead of full database
* fix: using schema instead of full database
* fix: using schema instead of full database
* chore: add debug log
* chore: remove debug log
* chore: remove debug log
* chore: fix cr
2023-03-01 10:34:57 +08:00
LFC
11d45e2918
refactor: upgrade DataFusion, Arrow and Sqlparser ( #1074 )
...
* refactor: upgrade DataFusion, Arrow and Sqlparser
* fix: resolve PR comments
2023-02-27 22:20:08 +08:00
shuiyisong
6afd79cab8
feat: support InfluxDB auth protocol ( #1034 )
...
* chore: add http auth influxdb compat
* chore: add test
* chore: minor change
* chore: fix typo
* chore: fix cr
2023-02-20 03:26:19 +00:00
fys
4e88a01638
feat: support influxdb ping and health endpoint ( #1027 )
...
* feat: support influxdb ping and health endpoint
* add some unit tests
* ping and health api no need auth
* cr
2023-02-20 02:31:51 +00:00
dennis zhuang
5ec1a7027b
feat: supports passing user params into coprocessor ( #962 )
...
* feat: make args in coprocessor optional
* feat: supports kwargs for coprocessor as params passed by the users
* feat: supports params for /run-script
* fix: we should rewrite the coprocessor by removing kwargs
* fix: remove println
* fix: compile error after rebasing
* fix: improve http_handler_test
* test: http scripts api with user params
* refactor: tweak all to_owned
2023-02-16 16:11:26 +08:00
Ruihang Xia
dfe7bfb07f
feat: handle PromQL HTTP API parameters ( #985 )
...
* feat: impl EvalStmt parser
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix compile errors
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update test result
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add integration test
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix clippy
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* resolve CR comments
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* impl From<PromqlQuery> for PromQuery
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* move format into with_context
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update test result
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* shorthand compound error
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* use rfc3339 error to report float parsing error
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* remove CompoundError
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-02-15 17:15:44 +08:00
shuiyisong
301656d568
fix: rename schema to db in http param ( #1008 )
...
chore: rename schema to db in http script handler
2023-02-15 15:59:00 +08:00
Xieqijun
63e396e9e9
test: add api and doc http test ( #998 )
...
* test:add api and doc test
* fix:conservation
2023-02-15 11:55:13 +08:00
Ning Sun
c1d32bdf2b
fix: add form data support for http sql api ( #955 )
...
fix: add form data support for http apis
2023-02-07 10:15:39 +00:00
ShenJunkun
afac885c10
refactor: add schema column to the scripts table ( #868 )
2023-02-07 11:07:32 +08:00
Ning Sun
4ae63b7089
feat: Initial prepare statement support for Postgres protocol ( #925 )
...
* feat: add describe statement to query_engine
* feat: add ability to describe statement for sql handler
* refactor: return schema instead of wrapped ref
* test: resolve tests
* feat: add initial support for prepared statements
* feat: add parameter types to query statement
* test: fix parser test
* chore: add todo task
* fix: turn on integer_datetime for binary timestamp
* fix: format string using single quote
* test: add tests for prepared statement
* Apply suggestions from code review
Co-authored-by: LFC <bayinamine@gmail.com >
* refactor: use stream api from recordbatches
---------
Co-authored-by: LFC <bayinamine@gmail.com >
2023-02-06 22:06:00 +08:00
Ruihang Xia
fc9276c79d
feat: export promql service in server ( #924 )
...
* chore: some tiny typo/style fix
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* feat: add promql server
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* works for mocked query
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* clean up
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* integration test case
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* resolve CR comments
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* expose promql api to our http server
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* resolve CR comments
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* adjust router structure
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-02-03 08:28:56 +00:00
LFC
af935671b2
feat: support "use" in GRPC requests ( #922 )
...
* feat: support "use catalog and schema"(behave like the "use" in MySQL) in GRPC requests
* fix: rebase develop
2023-02-02 20:02:56 +08:00
shuiyisong
6960739b3d
feat: add authorize to UserProvider trait ( #879 )
...
* feat: add SchemaValidator
* feat: add schema validator to mysql shim
* chore: pass schema validator to http auth layer
* feat: add schema validator to http
* feat: add schema validator to pg
* feat: add schema validator to pg
* feat: add schema validator test
* chore: remove println in test
* chore: use !matches
* refactor: refac authenticate and authorize in http auth
* refactor: refac authenticate and authorize in http auth
* chore: typo
* chore: minor change
* refactor: merge schema_validator into user_providier
* chore: fix license issue
* refactor: change http query param from database to db
* chore: fix cr issue
2023-01-18 12:42:08 +08:00
LFC
2664436194
feat: handle "USE <catalog>-<schema>" in MySQL ( #857 )
...
* feat: handle "USE <catalog>-<schema>" in MySQL
* fix: resolve PR comments
2023-01-12 11:12:11 +08:00
Lei, HUANG
8ffc078f88
fix: license header ( #815 )
2023-01-03 15:09:49 +08:00
shuiyisong
179ff728df
refactor: merge servers::context into session ( #811 )
...
* refactor: move context to session
* chore: add unit test
* chore: add pg, opentsdb, influxdb and prometheus to channel enum
2022-12-31 00:00:04 +08:00
LFC
de6803d253
feat: handle InsertRequest(formerly InsertExpr) in new Arrow Flight ( #800 )
...
feat: handle InsertRequest(formerly InsertExpr) in new Arrow Flight interface
2022-12-30 10:24:09 +08:00
LFC
ea9af42091
chore: upgrade Rust to nightly 2022-12-20 ( #772 )
...
* chore: upgrade Rust to nightly 2022-12-20
* chore: upgrade Rust to nightly 2022-12-20
Co-authored-by: luofucong <luofucong@greptime.com >
2022-12-21 19:32:30 +08:00
Ning Sun
539ead5460
feat: check database existence on http api ( #764 )
...
* feat: check database existance on http api
* Update src/servers/src/http/handler.rs
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
* feat: use database not found status code
* test: add assertion for status code
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
2022-12-21 10:28:45 +08:00
Ning Sun
ea1896493b
feat: allow multiple sql statements in query string ( #699 )
...
* feat: allow multiple sql statement in query string
* test: add a test for multiple statement call
* feat: add temprary workaround for standalone mode
* fix: resolve sql parser issue temporarily
* Update src/datanode/src/instance/sql.rs
Co-authored-by: Yingwen <realevenyag@gmail.com >
* fix: adopt new sql handler
* refactor: revert changes in query engine
* refactor: assume sql-statement 1-1 on datanode
* test: use frontend for integration test
* refactor: add statement execution api for explicit single statement call
* fix: typo
* refactor: rename query method
* test: add test case for error
* test: data type change adoption
* chore: add todo from review
* chore: remove obsolete comments
* fix: resolve resolve issues
Co-authored-by: Yingwen <realevenyag@gmail.com >
2022-12-16 19:50:20 +08:00
