Weny Xu
8a00424468
refactor: implement Display for TableRouteKey ( #1879 )
2023-07-05 09:42:16 +08:00
liyang
4b580f4037
feat: release binary to aws s3 ( #1881 )
2023-07-04 22:33:35 +08:00
Weny Xu
ee16262b45
feat: add create table procedure ( #1845 )
...
* feat: add create table procedure
* feat: change table_info type from vec u8 to RawTableInfo
* feat: return create table status
* fix: fix uncaught error
* refactor: use a notifier to respond to callers
* chore: apply suggestions from CR
* chore: apply suggestions from CR
* chore: add comment
* chore: apply suggestions from CR
* refacotr: make CreateMetadata step after DatanodeCreateTable step
2023-07-04 22:24:43 +08:00
Yingwen
f37b394f1a
fix: check table existence in create table procedure ( #1880 )
...
* fix: check table existence in table procedures
* fix: use correct error variant
* chore: address view comments
* chore: address comments
* test: change error code
2023-07-04 22:01:27 +08:00
Eugene Tolbakov
ccee60f37d
feat(http_body_limit): add initial support for DefaultBodyLimit ( #1860 )
...
* feat(http_body_limit): add initial support for DefaultBodyLimit
* fix: address CR suggestions
* fix: adjust the const for default http body limit
* fix: adjust the toml_str for the test
* fix: address CR suggestions
* fix: body_limit units in example config toml files
* fix: address clippy suggestions
2023-07-04 20:56:56 +08:00
Ruihang Xia
bee8323bae
chore: bump sqlness to 0.5.0 ( #1877 )
...
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-07-04 19:49:12 +08:00
Weny Xu
000df8cf1e
feat: add ddl client ( #1856 )
...
* feat: add ddl client
* chore: apply suggestions from CR
* chore: apply suggestions from CR
2023-07-04 19:32:02 +08:00
Yingwen
884731a2c8
chore: initialize mito2 crate ( #1875 )
2023-07-04 17:55:00 +08:00
shuiyisong
2922c25a16
chore: stop caching None in CachedMetaKvBackend ( #1871 )
...
* chore: dont cache none
* fix: test case
* chore: add comment
* chore: minor rewrite
2023-07-04 17:17:48 +08:00
Lei, HUANG
4dec06ec86
chore: bump version 0.3.2 ( #1876 )
...
bump version 0.3.2
2023-07-04 17:04:27 +08:00
Lei, HUANG
3b6f70cde3
feat: initial twcs impl ( #1851 )
...
* feat: initial twcs impl
* chore: rename SimplePicker to LeveledPicker
* rename some structs
* Remove Compaction strategy
* make compaction picker a trait object
* make compaction picker configurable for every region
* chore: add some test for ttl
* add some tests
* fix: some style issues in cr
* feat: enable twcs when creating tables
* feat: allow config time window when creating tables
* fix: some cr comments
2023-07-04 16:42:27 +08:00
Yingwen
b8e92292d2
feat: Implement a new scan mode using a chain reader ( #1857 )
...
* feat: add log
* feat: print more info
* feat: use chain reader
* fix: panic on getting first range
* fix: prev not updated
* fix: reverse readers and iter backward
* chore: don't print windows in log
* feat: consider memtable range
Also fix the issue that using incorrect comparision method to sort time
ranges.
* fix: merge memtable window with sst's
* feat: add use_chain_reader option
* feat: skip empty memtables
* chore: change log level
* fix: memtable range not ordered
* style: fix clippy
* chore: address review comments
* chore: print region id in log
2023-07-04 16:01:34 +08:00
Ruihang Xia
746fe8b4fe
fix: use mark-deletion for system catalog ( #1874 )
...
* fix: use mark-deletion for system catalog
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix the default value
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* clean tables
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-07-04 16:00:39 +08:00
JeremyHi
20f2fc4a2a
feat: add leader kv store cache for metadata ( #1853 )
...
* feat: add leader kv store cache for metadata
* refactor: create cache internal
* fix: race condition
* fix: race condition on read
2023-07-04 15:49:42 +08:00
Yingwen
2ef84f64f1
feat(servers): enlarge default body limit to 64M ( #1873 )
2023-07-04 07:13:14 +00:00
fys
451cc02d8d
chore: add feature for metrics-process, default enable ( #1870 )
...
chore: add feature for metrics process, default enable
2023-07-04 13:28:33 +08:00
Lei, HUANG
b466ef6cb6
fix: libz dependency ( #1867 )
2023-07-03 10:08:53 +00:00
LFC
5b42e15105
refactor: add TableInfoKey and TableRegionKey ( #1865 )
...
* refactor: add TableInfoKey and TableRegionKey
* refactor: move KvBackend to common-meta
* fix: resolve PR comments
2023-07-03 18:01:20 +08:00
shuiyisong
e1bb7acfe5
fix: return err msg if use wrong database in MySQL ( #1866 )
2023-07-03 17:31:09 +08:00
Lei, HUANG
2c0c4672b4
feat: support building binary for centos7 ( #1863 )
...
feat:support building binary for centos7
2023-07-03 14:13:55 +08:00
Cao Zhengjia
e54415e723
feat: Make heartbeat intervals configurable in Frontend and Datanode ( #1864 )
...
* update frontend options and config
* fix format
2023-07-03 12:08:47 +08:00
Ruihang Xia
783a794060
fix: break CI again 🥲 ( #1859 )
...
* fix information schema case
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* disable -Wunused_result lint
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-06-30 20:01:14 +08:00
Vanish
563f6e05e2
feat: remove all the manifests in drop_region. ( #1834 )
...
* feat: drop_region delete manifest file
* chore: remove redundant code
* chore: fmt
* chore: clippy
* chore: clippy
* feat: support delete_all in manifest.
* chore:CR
* test: test_drop_basic, test_drop_reopen
* chore: cr
* fix: typo
* chore: cr
2023-06-30 17:42:11 +08:00
Ruihang Xia
25cb667470
fix: sort unstable sqlness result ( #1858 )
...
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-06-30 09:25:24 +00:00
Ruihang Xia
c77b94650c
refactor: remove Table::scan method ( #1855 )
...
* remove scan method
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* clean up
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-06-30 12:13:14 +08:00
Ruihang Xia
605776f49c
feat: support bool operator with other computation ( #1844 )
...
* add some cases
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix sqlness test
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* impl atan2 and power
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix instant manipulator
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix clippy
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-06-29 19:23:54 +08:00
Ruihang Xia
d45e7b7480
refactor: build parquet file stream from ParquetExec ( #1852 )
...
* refactor: build parquet file stream from ParquetExec
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* rename sqlness case
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-06-29 19:19:31 +08:00
JeremyHi
2b3ca1309a
feat: table_routes util ( #1849 )
2023-06-29 16:47:56 +08:00
Weny Xu
acfa229641
chore: bump orc-rust to 0319acd ( #1847 )
2023-06-29 10:45:05 +08:00
JeremyHi
7e23dd7714
feat: http api for node-lease ( #1843 )
...
* feat: add node-lease http api
* revert: show_create.result
2023-06-29 09:34:54 +08:00
Lei, HUANG
559d1f73a2
feat: push all possible filters down to parquet exec ( #1839 )
...
* feat: push all possible filters down to parquet exec
* fix: project
* test: add ut for DatafusionArrowPredicate
* fix: according to CR comments
2023-06-28 20:14:37 +08:00
JeremyHi
bc33fdc8ef
feat: save node lease into memory ( #1841 )
...
* feat: lease secs = 5
* feat: set lease data into memory of leader
* fix: ignore stale heartbeat
* Update src/meta-srv/src/election.rs
Co-authored-by: LFC <bayinamine@gmail.com >
---------
Co-authored-by: LFC <bayinamine@gmail.com >
2023-06-28 11:54:06 +08:00
Lei, HUANG
f287d3115b
chore: replace result assertions ( #1840 )
...
* s/assert!\((.*)\.is_ok\(\)\);/\1.unwrap\(\);/g
* s/assert!\((.*)\.is_some\(\)\);/\1.unwrap\(\);/g
2023-06-27 19:14:48 +08:00
Ruihang Xia
b737a240de
fix: add sqlness tests for some promql function ( #1838 )
...
* correct range manipulate exec fmt text
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix partition requirement
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix udf signature
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* finilise
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* ignore unstable ordered result
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add nan value test
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-06-27 19:05:26 +08:00
fys
99f0479bd2
feat: improve influxdb v2 api compability ( #1831 )
...
* feat: support influxdb v2 api
* cr
2023-06-27 18:21:51 +08:00
fys
313121f2ae
fix: block when stream insert ( #1835 )
...
* fix: stream insert blocking
* fix: example link
* chore: Increase the default channel size "1024" -> "65536"
2023-06-27 16:57:03 +08:00
LFC
fcff66e039
chore: deny unused results ( #1825 )
...
* chore: deny unused results
* rebase
2023-06-27 15:33:53 +08:00
shuiyisong
03057cab6c
feat: physical plan wrapper ( #1837 )
...
* test: add physical plan wrapper trait
* test: add plugins to datanode initialization
* test: add plugins to datanode initialization
* chore: add metrics method
* chore: update meter-core version
* chore: remove unused code
* chore: impl metrics method on df execution plan adapter
* chore: minor comment fix
* chore: add retry in create table
* chore: shrink keep lease handler buffer
* chore: add etcd batch size warn
* chore: try shrink
* Revert "chore: try shrink"
This reverts commit 0361b51670waynestxia@gmail.com >
* calc elapsed time and rows
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* chore: remove timer in scan batch
* chore: add back stream metrics wrapper
* chore: add timer to ready poll
* chore: minor update
* chore: try using df_plan.metrics()
* chore: remove table scan timer
* chore: remove scan timer
* chore: add debug log
* Revert "chore: add debug log"
This reverts commit 672a0138fdwaynestxia@gmail.com >
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
2023-06-27 14:04:04 +08:00
Weny Xu
dcfce49cff
refactor(datanode): move Instance heartbeat task to Datanode struct ( #1832 )
...
* refactor(datanode): move Instance heartbeat to Datanode struct
* chore: apply suggestions from CR
* fix: start heartbeat task after instance starts
2023-06-27 12:32:20 +08:00
JeremyHi
78b07996b1
feat: txn for meta ( #1828 )
...
* feat: txn for meta kvstore
* feat: txn
* chore: add unit test
* chore: more test
* chore: more test
* Update src/meta-srv/src/service/store/memory.rs
Co-authored-by: LFC <bayinamine@gmail.com >
* chore: by cr
---------
Co-authored-by: LFC <bayinamine@gmail.com >
2023-06-26 17:12:48 +08:00
dennis zhuang
034564fd27
feat: make blob(binary) type working ( #1818 )
...
* feat: test blob type
* feat: make blob type working
* chore: comment
* Update src/sql/src/statements/insert.rs
Co-authored-by: Lei, HUANG <6406592+v0y4g3r@users.noreply.github.com >
* chore: by CR comments
* fix: comment
* Update src/sql/src/statements/insert.rs
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
* Update src/sql/src/statements/insert.rs
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
* fix: test
---------
Co-authored-by: Lei, HUANG <6406592+v0y4g3r@users.noreply.github.com >
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
2023-06-26 08:49:04 +00:00
Ruihang Xia
a95f8767a8
refactor: merge catalog provider & schema provider into catalog manager ( #1803 )
...
* move to expr_factory
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* move configs into service_config
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* move GrpcQueryHandler into distributed.rs
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix compile and test in catalog sub-crate
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* clean up
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix table-procedure compile and test
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix query compile and tests
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix datanode compile and tests
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix catalog/query/script/servers compile
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix frontend compile
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix nextest except information_schema
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* support information_schema
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix sqlness test
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix merge errors
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* remove other structs
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* clean up
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix format
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* change deregister_table's return type to empty tuple
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-06-26 15:08:59 +08:00
Eugene Tolbakov
964d26e415
fix: docker build for aarch64 ( #1826 )
2023-06-25 18:29:00 +09:00
Yingwen
fd412b7b07
refactor!: Uses table id to locate tables in table engines ( #1817 )
...
* refactor: add table_id to get_table()/table_exists()
* refactor: Add table_id to alter table request
* refactor: Add table id to DropTableRequest
* refactor: add table id to DropTableRequest
* refactor: Use table id as key for the tables map
* refactor: use table id as file engine's map key
* refactor: Remove table reference from engine's get_table/table_exists
* style: remove unused imports
* feat!: Add table id to TableRegionalValue
* style: fix cilppy
* chore: add comments and logs
2023-06-25 15:05:20 +08:00
Weny Xu
223cf31409
feat: support to copy from orc format ( #1814 )
...
* feat: support to copy from orc format
* test: add copy from orc test
* chore: add license header
* refactor: remove unimplemented macro
* chore: apply suggestions from CR
* chore: bump orc-rust to 0.2.3
2023-06-25 14:07:16 +08:00
Ruihang Xia
62f660e439
feat: implement metrics for Scan plan ( #1812 )
...
* add metrics in some interfaces
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* calc elapsed time and rows
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-06-25 14:06:50 +08:00
Lei, HUANG
0fb18245b8
fix: docker build ( #1822 )
2023-06-25 11:05:46 +08:00
Weny Xu
caed6879e6
refactor: remove redundant code ( #1821 )
2023-06-25 10:56:31 +08:00
Yingwen
5ab0747092
test(storage): wait task before checking scheduled task num ( #1811 )
2023-06-21 18:04:34 +08:00
Ruihang Xia
b1ccc7ef5d
fix: prevent filter pushdown in distributed planner ( #1806 )
...
* fix: prevent filter pushdown in distributed planner
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix metadata
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-06-21 16:25:50 +08:00
