shuiyisong
5df4d44761
feat: schema level opts ( #2283 )
...
* chore: update proto
* chore: add try from for schema name value
* chore: merge schema opts to table opts while creating table
* chore: use table ttl opts first
* chore: add unit test
* chore: update proto version
2023-08-30 08:11:08 +00:00
JeremyHi
c02ac36ce8
feat: avoid confusion in desc table ( #2272 )
...
feat: Field to Column to aviod confusion in DESC TABLE
2023-08-28 11:50:33 +00:00
Ruihang Xia
8d446ed741
fix: quote ident on rendered SQL ( #2248 )
...
* fix: quote ident on rendered SQL
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* read quote style from query context
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update sqlness result
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-08-25 07:25:21 +00:00
JeremyHi
de1daec680
feat: upgrade desc table output ( #2256 )
2023-08-25 06:52:22 +00:00
Zhenchi
9d87c8b6de
refactor(table): cleanup dist table ( #2255 )
...
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
2023-08-25 06:37:39 +00:00
Ruihang Xia
d581688fd2
fix: dist planner has wrong behavior in table with multiple partitions ( #2237 )
...
* fix: dist planner has wrong behavior in table with multiple partitions
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* Update tests/cases/distributed/explain/multi_partitions.sql
Co-authored-by: Zhenchi <zhongzc_arch@outlook.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: Zhenchi <zhongzc_arch@outlook.com >
2023-08-23 08:32:20 +00:00
Ruihang Xia
18250c4803
feat: implement Flight and gRPC services for RegionServer ( #2226 )
...
* extract FlightCraft trait
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* split service handler in GrpcServer
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* left grpc server implement
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* start region server if configured
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-08-22 13:30:09 +00:00
Niwaka
b3b43fe1c3
fix: table options can't be found in distributed mode ( #2209 )
...
* fix: table options can't be found in distributed mode
* refactor: use iterator for regions_numbers
* chore: remove TODO
2023-08-22 03:53:56 +00:00
JeremyHi
033b650d0d
feat: row write protocol ( #2189 )
...
* feat: datanode's row insrter
* refactor: ExprFactory
* feat: row inserter in standalon mode
* chore: minor refactor
* feat: influxdb line protocol's row protocol
* chore: minor refactor
* improve: avoid to use too many string
* no longer async
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
* chore: do not check empty data
* chore: by review comment
* chore: by comment
* chore: by review comment
* chore: by review comment
---------
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
2023-08-19 13:08:44 +00:00
Ruihang Xia
1bbec75f5b
fix: skip partition clause in show create table ( #2200 )
...
* fix: skip partition clause in show create table
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update test results
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-08-18 09:10:31 +00:00
Weny Xu
177036475a
fix: support to copy from parquet with typecast ( #2201 )
2023-08-18 03:09:54 +00:00
Ruihang Xia
4aaf6aa51b
feat: implement query API for RegionServer ( #2197 )
...
* some initial change
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* impl dummy structs
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* decode and send logical plan
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* implement table scan
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add some comments
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-08-17 11:02:31 +00:00
Weny Xu
6e6ff5a606
refactor: update table metadata in single txn ( #2172 )
...
* refactor: table-metadata-manager
* feat: remove comparing when deleting metadata
* fix: fix comment typos
* chore: apply suggestions from CR
* test: add tests for updating DatanodeTable
* fix: fix clippy
* chore: apply suggestions from CR
* refactor: improve update table route tests
* refactor: return Txn instead of TxnRequest
* chore: apply suggestions from CR
* chore: apply suggestions from CR
* refactor: update table metadata in single txn
* feat: check table exists before drop table executing
* test: add tests for table metadata manager
* refactor: remove table region manager
* chore: apply suggestions from CR
* feat: add bench program
* chore: apply suggestions from CR
2023-08-17 06:29:19 +00:00
sh2
202540823f
refactor!: move prometheus routes to default http server ( #2005 )
...
* move prometheus routes to default http server
Signed-off-by: sh2 <shawnhxh@outlook.com >
* fix ci test and remove the server logic of prometheus
* remove unused import and prometheus relevant code
* fix ci: rustfmt and test
* fix ci: silly fmt
* fix ci: silly silly fmt
* change `/prom_store` back to `/prometheus`
* remove unused variable
---------
Signed-off-by: sh2 <shawnhxh@outlook.com >
2023-08-16 03:21:14 +00:00
Niwaka
a8f2e4468d
feat: handle multiple grpc deletes ( #2150 )
...
* feat: handle multiple grpc deletes
* fix: make DistDeleter::grpc_delete return usize
* fix: remove backtrace from MissingTimeIndexColumn
* fix: avoid using unwrap in PartitionRuleManager::split_delete_request
* fix: simplify MissingTimeIndexColumn
2023-08-15 08:22:46 +00:00
Ning Sun
f3157df190
fix: normalize otlp string keys ( #2168 )
2023-08-14 09:39:54 +00:00
Weny Xu
5b012a1f67
feat!: switch to new catalog/schema key ( #2140 )
...
* feat!: switch to new catalog/schema key
* chore: apply suggestions from CR
2023-08-14 03:08:43 +00:00
shuiyisong
7f51141ed0
refactor: auth crate ( #2148 )
...
* chore: move user_info to auth crate
* chore: temp commit before resolving tests compile error
* chore: fix compile issue
* chore: minor fix
* chore: tmp save
* chore: change user_info to trait
* chore: minor change & use auth result user info in pg session setup
* chore: add as_any to user_info
* chore: rename user_info
* chore: remove ice file
* chore: add permission checker
* chore: add grpc permission check
* chore: add session spawn user_info to query_ctx
* chore: minor update
* chore: add permission checker to sql handler & temp save
* chore: add permission checker to prometheus handler
* chore: add permission checker to opentsdb handler
* chore: add permission checker to other handlers
* chore: add test
* chore: add user_info setting on http entrance
* chore: fix toml
* chore: remove box in permission req
* chore: cr issue
* chore: cr issue
2023-08-14 02:51:26 +00:00
dennis zhuang
6f40128058
feat!: enable telemetry by default ( #2137 )
...
* feat: remove greptimedb-telemetry feature
* feat: adds enable_telemetry option to metasrv and datanode
* refactor: move data_home from file config to storage config
* feat: store the installation uuid into datanode and metasrv working home
* fix: cargo toml fmt
* test: ignore region failver test when using local fle storage
* test: ignore telemetry reporter in test mode
* feat: print warning log when enabling telemetry
* chore: the telemetry doc link
* chore: remove enable_telemetry from datanode example config file
* refactor: rename GREPTIMEDB_TELEMETRY_CLIENT_REQUEST_TIMEOUT
* chore: rename print_warn_log to print_anonymous_usage_data_disclaimer
2023-08-11 14:50:40 +00:00
Ruihang Xia
b9bac2b195
fix: let information_schema know itself ( #2149 )
...
* rename show create table
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* register information_schema on registering catalog
* fix tests in standalone
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix frontend catalog manager
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add sqlness test
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix clippy
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix clippy & typo
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* tweak sqlness test
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* rename constructor
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* rename method
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix typo (again)
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* remove redundent clones
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-08-11 15:37:27 +08:00
LFC
5c19913a91
build: on windows ( #2054 )
...
* build on windows
* rebase develop
* fix: resolve PR comments
2023-08-10 08:08:37 +00:00
Zhenchi
7abe71f399
fix(table): return correct table types ( #2131 )
...
* fix(table): return correct table types
Signed-off-by: zhongzc <zhongzc@zhongzcs-MacBook-Pro.local >
* fix: NumbersTable to be Temporary table
Signed-off-by: zhongzc <zhongzc@zhongzcs-MacBook-Pro.local >
* fix(test): fix affected cases
Signed-off-by: zhongzc <zhongzc@zhongzcs-MacBook-Pro.local >
* fix(test): fix affected cases
Signed-off-by: zhongzc <zhongzc@zhongzcs-MacBook-Pro.local >
* fix: fmt
Signed-off-by: zhongzc <zhongzc@zhongzcs-MacBook-Pro.local >
* fix(tests): fix instance_test expected result
* retrigger action
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
---------
Signed-off-by: zhongzc <zhongzc@zhongzcs-MacBook-Pro.local >
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
Co-authored-by: zhongzc <zhongzc@zhongzcs-MacBook-Pro.local >
2023-08-09 11:07:00 +00:00
LFC
46fa3eb629
chore: upgrade rust toolchain to latest nightly ( #2049 )
...
* chore: upgrade rust toolchain to latest nightly
* rebase develop
* update rust toolchain in ci
2023-08-08 07:17:51 +00:00
shuiyisong
5eb2c609a3
fix: auth in grpc ( #2056 )
...
* fix: auth in grpc
* fix: change to return err
* fix: add grpc test
* fix: add http test
* fix: add mysql and pg test
2023-08-01 15:18:31 +00:00
JeremyHi
fd7eb87a52
refactor: common semantic-type ( #2057 )
2023-08-01 11:18:05 +00:00
Ruihang Xia
5bd80a74ab
feat: prepare for implementing considering partition key in the distributed planner ( #2000 )
...
* basic impl
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix frontend logic
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add sqlness test
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* check substrait compatibility before pushdown
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* going to revert some rules
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update sqlness result
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix test and clippy
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix compile error
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix typo
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* remove println
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* Apply suggestions from code review
Co-authored-by: Yingwen <realevenyag@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: Yingwen <realevenyag@gmail.com >
2023-07-31 12:36:23 +00:00
Niwaka
695398652c
feat: accept influxdb request without timestamp even if table doesn't exist ( #2041 )
...
* feat: accept influxdb request without timestamp even if table doesn't exist
* refactor: InsertRequests::try_from
* feat: check row number
2023-07-31 02:55:09 +00:00
shuiyisong
9c1f0234de
refactor: query context ( #2022 )
...
* chore: refactor query_context
* chore: remove use statement
* chore: make query_context build return arc
* fix: sqlness test
* fix: cr issue
* fix: use unwrap or else
2023-07-25 06:11:34 +00:00
gobraves
e3ac3298b1
feat: add orc stream ( #1981 )
...
* add orc stream #1820
* update orc stream
* fix: create orcstreamadapter with opt projection
* fix: license header
* docs: delete comment
2023-07-21 05:54:02 +00:00
Ning Sun
a7557b70f1
feat: Add more tags for OTLP metrics protocol ( #2003 )
...
* test: add integration tests for otlp
* feat: add resource and scope attributes as tag
2023-07-21 02:02:43 +00:00
LFC
172febb1af
refactor!: trying to replace TableGlobalValue, part 2 ( #1985 )
...
* refactor!: using the new table metadata values
* fix: resolve PR comments
* fix: resolve PR comments
* fix: resolve PR comments
2023-07-19 12:01:43 +00:00
LFC
7cf6c2bd5c
refactor: trying to replace TableGlobalValue, part 1 ( #1956 )
...
* refactor: trying to replace TableGlobalValue, part 1
* fix: resolve PR comments
2023-07-17 11:32:46 +08:00
JeremyHi
e4fd5d0fd3
refactor: let metasrv returns ref always ( #1954 )
2023-07-13 17:06:51 +08:00
LFC
4fdb6d2f21
refactor: remote catalog uses memory ( #1926 )
...
* refactor: remote catalog uses memory
* rebase develop
* fix: resolve PR comments
2023-07-12 09:33:33 +00:00
Eugene Tolbakov
674bfd85c7
chore(prom)!: rename prometheus(remote storage) to prom-store and promql(HTTP server) to prometheus ( #1931 )
...
* chore(prom): rename prometheus(remote storage) to prom-store and promql(HTTP server) to prometheus
* chore: apply clippy suggestions
* chore: adjust format according to rustfmt
2023-07-12 14:47:09 +08:00
Weny Xu
264c5ea720
feat: meta procedure options ( #1937 )
...
* feat: meta procedure options
* chore: tune meta procedure options in tests
* Update src/common/procedure/Cargo.toml
Co-authored-by: dennis zhuang <killme2008@gmail.com >
---------
Co-authored-by: dennis zhuang <killme2008@gmail.com >
2023-07-12 02:22:08 +00:00
Weny Xu
2d30f4c373
fix: fix broken CI ( #1933 )
2023-07-11 14:48:41 +08:00
Eugene Tolbakov
fc850c9988
feat(config-endpoint): add initial implementation ( #1896 )
...
* feat(config-endpoint): add initial implementation
* feat: add initial handler implementation
* fix: apply clippy suggestions, use axum response instead of string
* feat: address CR suggestions
* fix: minor adjustments in formatting
* fix: add a test
* feat: add to_toml_string method to options
* fix: adjust the assertion for the integration test
* fix: adjust expected indents
* fix: adjust assertion for the integration test
* fix: improve according to clippy
2023-07-11 11:08:32 +08:00
Weny Xu
b31fad5d52
feat: switch to using create table procedure ( #1861 )
...
* feat: switch to using create table procedure
* fix: add missing table_id and fix uncaught error
* refactor: remove unused code and metrics
* chore: apply suggestions from CR
* chore: remove unused attributes
* feat: add info log and metrics
* fix: fix conflicts
2023-07-10 10:08:09 +08:00
Weny Xu
28748edb0d
chore: bump proto to 917ead6 ( #1892 )
...
* feat: add table_id for ddl exprs
* chore: bump proto to 917ead6
2023-07-06 13:29:36 +08:00
Niwaka
66e5ed5483
feat: support gcs storage ( #1781 )
2023-07-05 23:03:51 +08:00
Cao Zhengjia
e54415e723
feat: Make heartbeat intervals configurable in Frontend and Datanode ( #1864 )
...
* update frontend options and config
* fix format
2023-07-03 12:08:47 +08:00
Ruihang Xia
c77b94650c
refactor: remove Table::scan method ( #1855 )
...
* remove scan method
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* clean up
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-06-30 12:13:14 +08:00
JeremyHi
bc33fdc8ef
feat: save node lease into memory ( #1841 )
...
* feat: lease secs = 5
* feat: set lease data into memory of leader
* fix: ignore stale heartbeat
* Update src/meta-srv/src/election.rs
Co-authored-by: LFC <bayinamine@gmail.com >
---------
Co-authored-by: LFC <bayinamine@gmail.com >
2023-06-28 11:54:06 +08:00
Lei, HUANG
f287d3115b
chore: replace result assertions ( #1840 )
...
* s/assert!\((.*)\.is_ok\(\)\);/\1.unwrap\(\);/g
* s/assert!\((.*)\.is_some\(\)\);/\1.unwrap\(\);/g
2023-06-27 19:14:48 +08:00
LFC
fcff66e039
chore: deny unused results ( #1825 )
...
* chore: deny unused results
* rebase
2023-06-27 15:33:53 +08:00
shuiyisong
03057cab6c
feat: physical plan wrapper ( #1837 )
...
* test: add physical plan wrapper trait
* test: add plugins to datanode initialization
* test: add plugins to datanode initialization
* chore: add metrics method
* chore: update meter-core version
* chore: remove unused code
* chore: impl metrics method on df execution plan adapter
* chore: minor comment fix
* chore: add retry in create table
* chore: shrink keep lease handler buffer
* chore: add etcd batch size warn
* chore: try shrink
* Revert "chore: try shrink"
This reverts commit 0361b51670waynestxia@gmail.com >
* calc elapsed time and rows
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* chore: remove timer in scan batch
* chore: add back stream metrics wrapper
* chore: add timer to ready poll
* chore: minor update
* chore: try using df_plan.metrics()
* chore: remove table scan timer
* chore: remove scan timer
* chore: add debug log
* Revert "chore: add debug log"
This reverts commit 672a0138fdwaynestxia@gmail.com >
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
2023-06-27 14:04:04 +08:00
Weny Xu
dcfce49cff
refactor(datanode): move Instance heartbeat task to Datanode struct ( #1832 )
...
* refactor(datanode): move Instance heartbeat to Datanode struct
* chore: apply suggestions from CR
* fix: start heartbeat task after instance starts
2023-06-27 12:32:20 +08:00
Ruihang Xia
a95f8767a8
refactor: merge catalog provider & schema provider into catalog manager ( #1803 )
...
* move to expr_factory
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* move configs into service_config
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* move GrpcQueryHandler into distributed.rs
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix compile and test in catalog sub-crate
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* clean up
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix table-procedure compile and test
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix query compile and tests
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix datanode compile and tests
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix catalog/query/script/servers compile
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix frontend compile
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix nextest except information_schema
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* support information_schema
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix sqlness test
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix merge errors
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* remove other structs
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* clean up
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix format
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* change deregister_table's return type to empty tuple
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-06-26 15:08:59 +08:00
Weny Xu
223cf31409
feat: support to copy from orc format ( #1814 )
...
* feat: support to copy from orc format
* test: add copy from orc test
* chore: add license header
* refactor: remove unimplemented macro
* chore: apply suggestions from CR
* chore: bump orc-rust to 0.2.3
2023-06-25 14:07:16 +08:00
