sh2
202540823f
refactor!: move prometheus routes to default http server ( #2005 )
...
* move prometheus routes to default http server
Signed-off-by: sh2 <shawnhxh@outlook.com >
* fix ci test and remove the server logic of prometheus
* remove unused import and prometheus relevant code
* fix ci: rustfmt and test
* fix ci: silly fmt
* fix ci: silly silly fmt
* change `/prom_store` back to `/prometheus`
* remove unused variable
---------
Signed-off-by: sh2 <shawnhxh@outlook.com >
2023-08-16 03:21:14 +00:00
Niwaka
a8f2e4468d
feat: handle multiple grpc deletes ( #2150 )
...
* feat: handle multiple grpc deletes
* fix: make DistDeleter::grpc_delete return usize
* fix: remove backtrace from MissingTimeIndexColumn
* fix: avoid using unwrap in PartitionRuleManager::split_delete_request
* fix: simplify MissingTimeIndexColumn
2023-08-15 08:22:46 +00:00
Ning Sun
f3157df190
fix: normalize otlp string keys ( #2168 )
2023-08-14 09:39:54 +00:00
Weny Xu
5b012a1f67
feat!: switch to new catalog/schema key ( #2140 )
...
* feat!: switch to new catalog/schema key
* chore: apply suggestions from CR
2023-08-14 03:08:43 +00:00
shuiyisong
7f51141ed0
refactor: auth crate ( #2148 )
...
* chore: move user_info to auth crate
* chore: temp commit before resolving tests compile error
* chore: fix compile issue
* chore: minor fix
* chore: tmp save
* chore: change user_info to trait
* chore: minor change & use auth result user info in pg session setup
* chore: add as_any to user_info
* chore: rename user_info
* chore: remove ice file
* chore: add permission checker
* chore: add grpc permission check
* chore: add session spawn user_info to query_ctx
* chore: minor update
* chore: add permission checker to sql handler & temp save
* chore: add permission checker to prometheus handler
* chore: add permission checker to opentsdb handler
* chore: add permission checker to other handlers
* chore: add test
* chore: add user_info setting on http entrance
* chore: fix toml
* chore: remove box in permission req
* chore: cr issue
* chore: cr issue
2023-08-14 02:51:26 +00:00
dennis zhuang
6f40128058
feat!: enable telemetry by default ( #2137 )
...
* feat: remove greptimedb-telemetry feature
* feat: adds enable_telemetry option to metasrv and datanode
* refactor: move data_home from file config to storage config
* feat: store the installation uuid into datanode and metasrv working home
* fix: cargo toml fmt
* test: ignore region failver test when using local fle storage
* test: ignore telemetry reporter in test mode
* feat: print warning log when enabling telemetry
* chore: the telemetry doc link
* chore: remove enable_telemetry from datanode example config file
* refactor: rename GREPTIMEDB_TELEMETRY_CLIENT_REQUEST_TIMEOUT
* chore: rename print_warn_log to print_anonymous_usage_data_disclaimer
2023-08-11 14:50:40 +00:00
Ruihang Xia
b9bac2b195
fix: let information_schema know itself ( #2149 )
...
* rename show create table
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* register information_schema on registering catalog
* fix tests in standalone
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix frontend catalog manager
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add sqlness test
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix clippy
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix clippy & typo
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* tweak sqlness test
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* rename constructor
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* rename method
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix typo (again)
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* remove redundent clones
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-08-11 15:37:27 +08:00
LFC
5c19913a91
build: on windows ( #2054 )
...
* build on windows
* rebase develop
* fix: resolve PR comments
2023-08-10 08:08:37 +00:00
Zhenchi
7abe71f399
fix(table): return correct table types ( #2131 )
...
* fix(table): return correct table types
Signed-off-by: zhongzc <zhongzc@zhongzcs-MacBook-Pro.local >
* fix: NumbersTable to be Temporary table
Signed-off-by: zhongzc <zhongzc@zhongzcs-MacBook-Pro.local >
* fix(test): fix affected cases
Signed-off-by: zhongzc <zhongzc@zhongzcs-MacBook-Pro.local >
* fix(test): fix affected cases
Signed-off-by: zhongzc <zhongzc@zhongzcs-MacBook-Pro.local >
* fix: fmt
Signed-off-by: zhongzc <zhongzc@zhongzcs-MacBook-Pro.local >
* fix(tests): fix instance_test expected result
* retrigger action
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
---------
Signed-off-by: zhongzc <zhongzc@zhongzcs-MacBook-Pro.local >
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
Co-authored-by: zhongzc <zhongzc@zhongzcs-MacBook-Pro.local >
2023-08-09 11:07:00 +00:00
Ning Sun
d18eb18b32
feat: use server inferenced types on statement describe ( #2032 )
...
* feat: use server inferenced types on statement describe
* feat: add support for server inferenced type
* feat: allow parameter type inferencing
* chore: update comments
* fix: lint issue
* style: comfort rustfmt
* Update src/servers/src/postgres/types.rs
Co-authored-by: Yingwen <realevenyag@gmail.com >
---------
Co-authored-by: Yingwen <realevenyag@gmail.com >
2023-08-09 02:57:56 +00:00
Ning Sun
c39de9072f
refactor: use workspace dependencies for internal modules ( #2119 )
...
* refactor: use workspace dependencies for internal modules
* fix: resolve issue with mock module in datanode
* refactor: update test modules
2023-08-08 11:02:34 +00:00
LFC
46fa3eb629
chore: upgrade rust toolchain to latest nightly ( #2049 )
...
* chore: upgrade rust toolchain to latest nightly
* rebase develop
* update rust toolchain in ci
2023-08-08 07:17:51 +00:00
shuiyisong
7efff2d704
fix: introduce taplo.toml and sort Cargo.toml ( #2096 )
...
* fix: add taplo.toml
* fix: introduce taplo.toml & sort cargo.toml
* chore: remove option in ci too
2023-08-04 06:44:45 +00:00
Ruihang Xia
5f0403c245
feat: improve /label and /labels APIs in prometheus server ( #2087 )
...
* support __name__ for /label
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* make match[] in labels optional
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* Apply suggestions from code review
Co-authored-by: Yingwen <realevenyag@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: Yingwen <realevenyag@gmail.com >
2023-08-03 07:51:08 +00:00
shuiyisong
5eb2c609a3
fix: auth in grpc ( #2056 )
...
* fix: auth in grpc
* fix: change to return err
* fix: add grpc test
* fix: add http test
* fix: add mysql and pg test
2023-08-01 15:18:31 +00:00
JeremyHi
fd7eb87a52
refactor: common semantic-type ( #2057 )
2023-08-01 11:18:05 +00:00
Ruihang Xia
5bd80a74ab
feat: prepare for implementing considering partition key in the distributed planner ( #2000 )
...
* basic impl
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix frontend logic
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add sqlness test
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* check substrait compatibility before pushdown
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* going to revert some rules
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update sqlness result
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix test and clippy
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix compile error
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix typo
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* remove println
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* Apply suggestions from code review
Co-authored-by: Yingwen <realevenyag@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: Yingwen <realevenyag@gmail.com >
2023-07-31 12:36:23 +00:00
Niwaka
695398652c
feat: accept influxdb request without timestamp even if table doesn't exist ( #2041 )
...
* feat: accept influxdb request without timestamp even if table doesn't exist
* refactor: InsertRequests::try_from
* feat: check row number
2023-07-31 02:55:09 +00:00
shuiyisong
9c1f0234de
refactor: query context ( #2022 )
...
* chore: refactor query_context
* chore: remove use statement
* chore: make query_context build return arc
* fix: sqlness test
* fix: cr issue
* fix: use unwrap or else
2023-07-25 06:11:34 +00:00
shuiyisong
632cb26430
feat: trace_id in query context ( #2014 )
...
* chore: unify once_cell version
* chore: update cargo lock
* chore: add gen_trace_id
* chore: add trace_id to query_ctx
* chore: add debug log
* Revert "chore: add debug log"
This reverts commit f52ab3bb300f1d73117cd6ebbd8e0162829b1aba.
* chore: add frontend node id option
* chore: add query ctx to query engine ctx
* chore: set trace_id to logical_plan api
* chore: add trace_id in grpc entrance
* chore: generate trace_id while creating query_ctx
* chore: fix typo
* chore: extract trace_id from grpc header
* chore: extract trace_id from grpc header
* chore: fix clippy
* chore: add `QueryContextBuilder`
* chore: change node_id in fe to string
2023-07-24 07:35:06 +00:00
JeremyHi
41139ec11d
feat: region lease improve ( #2004 )
...
* feat: add exists api into KvBackend
* refactor: region lease
* feat: fiter out inactive node in keep-lease
* feat: register&deregister inactive node
* chore: doc
* chore: ut
* chore: minor refactor
* feat: use memory_kv to store inactive node
* fix: use real error in
* chore: make inactive_node_manager's func compact
* chore: more efficiently
* feat: clear inactive status on cadidate node
2023-07-24 03:49:14 +00:00
gobraves
e3ac3298b1
feat: add orc stream ( #1981 )
...
* add orc stream #1820
* update orc stream
* fix: create orcstreamadapter with opt projection
* fix: license header
* docs: delete comment
2023-07-21 05:54:02 +00:00
Ning Sun
a7557b70f1
feat: Add more tags for OTLP metrics protocol ( #2003 )
...
* test: add integration tests for otlp
* feat: add resource and scope attributes as tag
2023-07-21 02:02:43 +00:00
LFC
172febb1af
refactor!: trying to replace TableGlobalValue, part 2 ( #1985 )
...
* refactor!: using the new table metadata values
* fix: resolve PR comments
* fix: resolve PR comments
* fix: resolve PR comments
2023-07-19 12:01:43 +00:00
Eugene Tolbakov
6811acb314
fix(status_endpoint): add default value for hostname ( #1972 )
...
* fix(status_endpoint): add default value for hostname
* fix: adjust according to clippy suggestions
* fix: adjust according to CR suggestions
2023-07-17 11:55:11 +00:00
LFC
7cf6c2bd5c
refactor: trying to replace TableGlobalValue, part 1 ( #1956 )
...
* refactor: trying to replace TableGlobalValue, part 1
* fix: resolve PR comments
2023-07-17 11:32:46 +08:00
Kree0
8f71ac2172
refactor: move heartbeat configuration into an independent section ( #1976 )
...
refactor: move heartbeat configuration into an independent section in config file
* refactor: move heartbeat configuration into an independent section in config file
* feat: add HeartbeatOptions struct
* test: modify corresponding test case
* chore: modify corresponding example file
2023-07-17 11:29:02 +08:00
JeremyHi
e4fd5d0fd3
refactor: let metasrv returns ref always ( #1954 )
2023-07-13 17:06:51 +08:00
LFC
4fdb6d2f21
refactor: remote catalog uses memory ( #1926 )
...
* refactor: remote catalog uses memory
* rebase develop
* fix: resolve PR comments
2023-07-12 09:33:33 +00:00
Eugene Tolbakov
674bfd85c7
chore(prom)!: rename prometheus(remote storage) to prom-store and promql(HTTP server) to prometheus ( #1931 )
...
* chore(prom): rename prometheus(remote storage) to prom-store and promql(HTTP server) to prometheus
* chore: apply clippy suggestions
* chore: adjust format according to rustfmt
2023-07-12 14:47:09 +08:00
Weny Xu
264c5ea720
feat: meta procedure options ( #1937 )
...
* feat: meta procedure options
* chore: tune meta procedure options in tests
* Update src/common/procedure/Cargo.toml
Co-authored-by: dennis zhuang <killme2008@gmail.com >
---------
Co-authored-by: dennis zhuang <killme2008@gmail.com >
2023-07-12 02:22:08 +00:00
Weny Xu
2d30f4c373
fix: fix broken CI ( #1933 )
2023-07-11 14:48:41 +08:00
Eugene Tolbakov
fc850c9988
feat(config-endpoint): add initial implementation ( #1896 )
...
* feat(config-endpoint): add initial implementation
* feat: add initial handler implementation
* fix: apply clippy suggestions, use axum response instead of string
* feat: address CR suggestions
* fix: minor adjustments in formatting
* fix: add a test
* feat: add to_toml_string method to options
* fix: adjust the assertion for the integration test
* fix: adjust expected indents
* fix: adjust assertion for the integration test
* fix: improve according to clippy
2023-07-11 11:08:32 +08:00
Ning Sun
f293126315
feat: add logical plan based prepare statement for postgresql ( #1813 )
...
* feat: add logical plan based prepare statement for postgresql
* refactor: correct more types
* Update src/servers/src/postgres/types.rs
Co-authored-by: LFC <bayinamine@gmail.com >
* fix: address review issues
* test: add datetime in integration tests
---------
Co-authored-by: LFC <bayinamine@gmail.com >
2023-07-11 11:07:18 +08:00
Weny Xu
ed756288b3
fix: fix uncaught error ( #1924 )
2023-07-10 17:46:11 +08:00
Weny Xu
b31fad5d52
feat: switch to using create table procedure ( #1861 )
...
* feat: switch to using create table procedure
* fix: add missing table_id and fix uncaught error
* refactor: remove unused code and metrics
* chore: apply suggestions from CR
* chore: remove unused attributes
* feat: add info log and metrics
* fix: fix conflicts
2023-07-10 10:08:09 +08:00
LFC
f19498f73e
refactor: unify KvBackend and KvStore ( #1890 )
...
* refactor: unify KvBackend and KvStore
2023-07-07 19:53:49 +08:00
Weny Xu
28748edb0d
chore: bump proto to 917ead6 ( #1892 )
...
* feat: add table_id for ddl exprs
* chore: bump proto to 917ead6
2023-07-06 13:29:36 +08:00
Niwaka
66e5ed5483
feat: support gcs storage ( #1781 )
2023-07-05 23:03:51 +08:00
shuiyisong
2922c25a16
chore: stop caching None in CachedMetaKvBackend ( #1871 )
...
* chore: dont cache none
* fix: test case
* chore: add comment
* chore: minor rewrite
2023-07-04 17:17:48 +08:00
LFC
5b42e15105
refactor: add TableInfoKey and TableRegionKey ( #1865 )
...
* refactor: add TableInfoKey and TableRegionKey
* refactor: move KvBackend to common-meta
* fix: resolve PR comments
2023-07-03 18:01:20 +08:00
Cao Zhengjia
e54415e723
feat: Make heartbeat intervals configurable in Frontend and Datanode ( #1864 )
...
* update frontend options and config
* fix format
2023-07-03 12:08:47 +08:00
Ruihang Xia
c77b94650c
refactor: remove Table::scan method ( #1855 )
...
* remove scan method
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* clean up
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-06-30 12:13:14 +08:00
JeremyHi
bc33fdc8ef
feat: save node lease into memory ( #1841 )
...
* feat: lease secs = 5
* feat: set lease data into memory of leader
* fix: ignore stale heartbeat
* Update src/meta-srv/src/election.rs
Co-authored-by: LFC <bayinamine@gmail.com >
---------
Co-authored-by: LFC <bayinamine@gmail.com >
2023-06-28 11:54:06 +08:00
Lei, HUANG
f287d3115b
chore: replace result assertions ( #1840 )
...
* s/assert!\((.*)\.is_ok\(\)\);/\1.unwrap\(\);/g
* s/assert!\((.*)\.is_some\(\)\);/\1.unwrap\(\);/g
2023-06-27 19:14:48 +08:00
LFC
fcff66e039
chore: deny unused results ( #1825 )
...
* chore: deny unused results
* rebase
2023-06-27 15:33:53 +08:00
shuiyisong
03057cab6c
feat: physical plan wrapper ( #1837 )
...
* test: add physical plan wrapper trait
* test: add plugins to datanode initialization
* test: add plugins to datanode initialization
* chore: add metrics method
* chore: update meter-core version
* chore: remove unused code
* chore: impl metrics method on df execution plan adapter
* chore: minor comment fix
* chore: add retry in create table
* chore: shrink keep lease handler buffer
* chore: add etcd batch size warn
* chore: try shrink
* Revert "chore: try shrink"
This reverts commit 0361b51670waynestxia@gmail.com >
* calc elapsed time and rows
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* chore: remove timer in scan batch
* chore: add back stream metrics wrapper
* chore: add timer to ready poll
* chore: minor update
* chore: try using df_plan.metrics()
* chore: remove table scan timer
* chore: remove scan timer
* chore: add debug log
* Revert "chore: add debug log"
This reverts commit 672a0138fdwaynestxia@gmail.com >
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
2023-06-27 14:04:04 +08:00
Weny Xu
dcfce49cff
refactor(datanode): move Instance heartbeat task to Datanode struct ( #1832 )
...
* refactor(datanode): move Instance heartbeat to Datanode struct
* chore: apply suggestions from CR
* fix: start heartbeat task after instance starts
2023-06-27 12:32:20 +08:00
dennis zhuang
034564fd27
feat: make blob(binary) type working ( #1818 )
...
* feat: test blob type
* feat: make blob type working
* chore: comment
* Update src/sql/src/statements/insert.rs
Co-authored-by: Lei, HUANG <6406592+v0y4g3r@users.noreply.github.com >
* chore: by CR comments
* fix: comment
* Update src/sql/src/statements/insert.rs
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
* Update src/sql/src/statements/insert.rs
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
* fix: test
---------
Co-authored-by: Lei, HUANG <6406592+v0y4g3r@users.noreply.github.com >
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
2023-06-26 08:49:04 +00:00
Ruihang Xia
a95f8767a8
refactor: merge catalog provider & schema provider into catalog manager ( #1803 )
...
* move to expr_factory
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* move configs into service_config
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* move GrpcQueryHandler into distributed.rs
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix compile and test in catalog sub-crate
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* clean up
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix table-procedure compile and test
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix query compile and tests
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix datanode compile and tests
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix catalog/query/script/servers compile
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix frontend compile
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix nextest except information_schema
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* support information_schema
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix sqlness test
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix merge errors
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* remove other structs
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* clean up
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix format
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* change deregister_table's return type to empty tuple
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-06-26 15:08:59 +08:00
