shuiyisong
e1bb7acfe5
fix: return err msg if use wrong database in MySQL ( #1866 )
2023-07-03 17:31:09 +08:00
Lei, HUANG
2c0c4672b4
feat: support building binary for centos7 ( #1863 )
...
feat:support building binary for centos7
2023-07-03 14:13:55 +08:00
Cao Zhengjia
e54415e723
feat: Make heartbeat intervals configurable in Frontend and Datanode ( #1864 )
...
* update frontend options and config
* fix format
2023-07-03 12:08:47 +08:00
Ruihang Xia
783a794060
fix: break CI again 🥲 ( #1859 )
...
* fix information schema case
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* disable -Wunused_result lint
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
v0.4.0-nightly-20230703
2023-06-30 20:01:14 +08:00
Vanish
563f6e05e2
feat: remove all the manifests in drop_region. ( #1834 )
...
* feat: drop_region delete manifest file
* chore: remove redundant code
* chore: fmt
* chore: clippy
* chore: clippy
* feat: support delete_all in manifest.
* chore:CR
* test: test_drop_basic, test_drop_reopen
* chore: cr
* fix: typo
* chore: cr
2023-06-30 17:42:11 +08:00
Ruihang Xia
25cb667470
fix: sort unstable sqlness result ( #1858 )
...
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-06-30 09:25:24 +00:00
Ruihang Xia
c77b94650c
refactor: remove Table::scan method ( #1855 )
...
* remove scan method
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* clean up
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-06-30 12:13:14 +08:00
Ruihang Xia
605776f49c
feat: support bool operator with other computation ( #1844 )
...
* add some cases
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix sqlness test
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* impl atan2 and power
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix instant manipulator
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix clippy
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-06-29 19:23:54 +08:00
Ruihang Xia
d45e7b7480
refactor: build parquet file stream from ParquetExec ( #1852 )
...
* refactor: build parquet file stream from ParquetExec
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* rename sqlness case
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-06-29 19:19:31 +08:00
JeremyHi
2b3ca1309a
feat: table_routes util ( #1849 )
2023-06-29 16:47:56 +08:00
Weny Xu
acfa229641
chore: bump orc-rust to 0319acd ( #1847 )
2023-06-29 10:45:05 +08:00
JeremyHi
7e23dd7714
feat: http api for node-lease ( #1843 )
...
* feat: add node-lease http api
* revert: show_create.result
2023-06-29 09:34:54 +08:00
Lei, HUANG
559d1f73a2
feat: push all possible filters down to parquet exec ( #1839 )
...
* feat: push all possible filters down to parquet exec
* fix: project
* test: add ut for DatafusionArrowPredicate
* fix: according to CR comments
2023-06-28 20:14:37 +08:00
JeremyHi
bc33fdc8ef
feat: save node lease into memory ( #1841 )
...
* feat: lease secs = 5
* feat: set lease data into memory of leader
* fix: ignore stale heartbeat
* Update src/meta-srv/src/election.rs
Co-authored-by: LFC <bayinamine@gmail.com >
---------
Co-authored-by: LFC <bayinamine@gmail.com >
2023-06-28 11:54:06 +08:00
Lei, HUANG
f287d3115b
chore: replace result assertions ( #1840 )
...
* s/assert!\((.*)\.is_ok\(\)\);/\1.unwrap\(\);/g
* s/assert!\((.*)\.is_some\(\)\);/\1.unwrap\(\);/g
2023-06-27 19:14:48 +08:00
Ruihang Xia
b737a240de
fix: add sqlness tests for some promql function ( #1838 )
...
* correct range manipulate exec fmt text
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix partition requirement
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix udf signature
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* finilise
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* ignore unstable ordered result
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add nan value test
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-06-27 19:05:26 +08:00
fys
99f0479bd2
feat: improve influxdb v2 api compability ( #1831 )
...
* feat: support influxdb v2 api
* cr
2023-06-27 18:21:51 +08:00
fys
313121f2ae
fix: block when stream insert ( #1835 )
...
* fix: stream insert blocking
* fix: example link
* chore: Increase the default channel size "1024" -> "65536"
2023-06-27 16:57:03 +08:00
LFC
fcff66e039
chore: deny unused results ( #1825 )
...
* chore: deny unused results
* rebase
2023-06-27 15:33:53 +08:00
shuiyisong
03057cab6c
feat: physical plan wrapper ( #1837 )
...
* test: add physical plan wrapper trait
* test: add plugins to datanode initialization
* test: add plugins to datanode initialization
* chore: add metrics method
* chore: update meter-core version
* chore: remove unused code
* chore: impl metrics method on df execution plan adapter
* chore: minor comment fix
* chore: add retry in create table
* chore: shrink keep lease handler buffer
* chore: add etcd batch size warn
* chore: try shrink
* Revert "chore: try shrink"
This reverts commit 0361b51670 .
* chore: add create table backup time
* add metrics in some interfaces
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* calc elapsed time and rows
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* chore: remove timer in scan batch
* chore: add back stream metrics wrapper
* chore: add timer to ready poll
* chore: minor update
* chore: try using df_plan.metrics()
* chore: remove table scan timer
* chore: remove scan timer
* chore: add debug log
* Revert "chore: add debug log"
This reverts commit 672a0138fd .
* chore: use batch size as row count
* chore: use batch size as row count
* chore: tune code for pr
* chore: rename to physical plan wrapper
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
2023-06-27 14:04:04 +08:00
Weny Xu
dcfce49cff
refactor(datanode): move Instance heartbeat task to Datanode struct ( #1832 )
...
* refactor(datanode): move Instance heartbeat to Datanode struct
* chore: apply suggestions from CR
* fix: start heartbeat task after instance starts
2023-06-27 12:32:20 +08:00
JeremyHi
78b07996b1
feat: txn for meta ( #1828 )
...
* feat: txn for meta kvstore
* feat: txn
* chore: add unit test
* chore: more test
* chore: more test
* Update src/meta-srv/src/service/store/memory.rs
Co-authored-by: LFC <bayinamine@gmail.com >
* chore: by cr
---------
Co-authored-by: LFC <bayinamine@gmail.com >
2023-06-26 17:12:48 +08:00
dennis zhuang
034564fd27
feat: make blob(binary) type working ( #1818 )
...
* feat: test blob type
* feat: make blob type working
* chore: comment
* Update src/sql/src/statements/insert.rs
Co-authored-by: Lei, HUANG <6406592+v0y4g3r@users.noreply.github.com >
* chore: by CR comments
* fix: comment
* Update src/sql/src/statements/insert.rs
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
* Update src/sql/src/statements/insert.rs
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
* fix: test
---------
Co-authored-by: Lei, HUANG <6406592+v0y4g3r@users.noreply.github.com >
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
2023-06-26 08:49:04 +00:00
Ruihang Xia
a95f8767a8
refactor: merge catalog provider & schema provider into catalog manager ( #1803 )
...
* move to expr_factory
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* move configs into service_config
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* move GrpcQueryHandler into distributed.rs
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix compile and test in catalog sub-crate
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* clean up
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix table-procedure compile and test
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix query compile and tests
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix datanode compile and tests
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix catalog/query/script/servers compile
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix frontend compile
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix nextest except information_schema
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* support information_schema
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix sqlness test
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix merge errors
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* remove other structs
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* clean up
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix format
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* change deregister_table's return type to empty tuple
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-06-26 15:08:59 +08:00
Eugene Tolbakov
964d26e415
fix: docker build for aarch64 ( #1826 )
v0.4.0-nightly-20230626
2023-06-25 18:29:00 +09:00
Yingwen
fd412b7b07
refactor!: Uses table id to locate tables in table engines ( #1817 )
...
* refactor: add table_id to get_table()/table_exists()
* refactor: Add table_id to alter table request
* refactor: Add table id to DropTableRequest
* refactor: add table id to DropTableRequest
* refactor: Use table id as key for the tables map
* refactor: use table id as file engine's map key
* refactor: Remove table reference from engine's get_table/table_exists
* style: remove unused imports
* feat!: Add table id to TableRegionalValue
* style: fix cilppy
* chore: add comments and logs
2023-06-25 15:05:20 +08:00
Weny Xu
223cf31409
feat: support to copy from orc format ( #1814 )
...
* feat: support to copy from orc format
* test: add copy from orc test
* chore: add license header
* refactor: remove unimplemented macro
* chore: apply suggestions from CR
* chore: bump orc-rust to 0.2.3
2023-06-25 14:07:16 +08:00
Ruihang Xia
62f660e439
feat: implement metrics for Scan plan ( #1812 )
...
* add metrics in some interfaces
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* calc elapsed time and rows
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-06-25 14:06:50 +08:00
Lei, HUANG
0fb18245b8
fix: docker build ( #1822 )
2023-06-25 11:05:46 +08:00
Weny Xu
caed6879e6
refactor: remove redundant code ( #1821 )
2023-06-25 10:56:31 +08:00
Yingwen
5ab0747092
test(storage): wait task before checking scheduled task num ( #1811 )
v0.3.1-nightly-20230621
2023-06-21 18:04:34 +08:00
Ruihang Xia
b1ccc7ef5d
fix: prevent filter pushdown in distributed planner ( #1806 )
...
* fix: prevent filter pushdown in distributed planner
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix metadata
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-06-21 16:25:50 +08:00
Lei, HUANG
d1b5ce0d35
chore: check catalog deregister result ( #1810 )
...
* chore: check deregister result and return error on failure
* refactor: SystemCatalog::deregister_table returns Result<()>
2023-06-21 08:09:11 +00:00
Lei, HUANG
a314993ab4
chore: change logstore default config ( #1809 )
2023-06-21 07:34:24 +00:00
LFC
fa522bc579
fix: drop region alive countdown tasks when deregistering table ( #1808 )
2023-06-21 14:49:32 +08:00
Lei, HUANG
5335203360
feat: support cross compilation to aarch64 linux ( #1802 )
2023-06-21 14:08:45 +08:00
Ruihang Xia
23bf55a265
fix: __field__ matcher on single value column ( #1805 )
...
* fix error text and field_column_names
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add sqlness test
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add empty line
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* improve style
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-06-21 10:59:58 +08:00
Eugene Tolbakov
3b91fc2c64
feat: add initial implementation for status endpoint ( #1789 )
...
* feat: add initial implementation for status endpoint
* feat(status_endpoint): add more data to response
* feat(status_endpoint): use build data env vars
* feat(status_endpoint): add simple test
* fix(status_endpoint): adjust the toml indentation
2023-06-21 10:50:08 +08:00
LFC
6205616301
fix: filter table regional values with the current node id ( #1800 )
v0.4.0-nightly-20230621
v0.4.0-nightly-20230620
2023-06-20 19:17:35 +08:00
JeremyHi
e47ef1f0d2
chore: minor fix ( #1801 )
2023-06-20 11:03:52 +00:00
Lei, HUANG
16c1ee2618
feat: incremental database backup ( #1240 )
...
* feat: incremental database backup
* chore: rebase develop
* chore: move backup to StatementExecutor
* feat: copy database parser
* chore: remove some todos
* chore: use timestamp string instead of i64 string
* fix: typo
2023-06-20 18:26:55 +08:00
JeremyHi
323e2aed07
feat: deal with more than 128 txn ( #1799 )
2023-06-20 17:56:45 +08:00
LFC
cbc2620a59
feat: start region alive keepers ( #1796 )
...
* feat: start region alive keepers
2023-06-20 15:45:29 +08:00
JeremyHi
4fdee5ea3c
feat: deal with node epoch ( #1795 )
...
* feat: deal with node epoch
* feat: dn send node_epoch
* Update src/meta-srv/src/handler/persist_stats_handler.rs
Co-authored-by: dennis zhuang <killme2008@gmail.com >
* Update src/meta-srv/src/service/store/ext.rs
Co-authored-by: dennis zhuang <killme2008@gmail.com >
* chore: by cr
---------
Co-authored-by: dennis zhuang <killme2008@gmail.com >
2023-06-20 07:07:05 +00:00
dennis zhuang
30472cebae
feat: prepare supports caching logical plan and infering param types ( #1776 )
...
* feat: change do_describe function signature
* feat: infer param type and cache logical plan for msyql prepared statments
* fix: convert_value
* fix: forgot helper
* chore: comments
* fix: typo
* test: add more tests and test date, datatime in mysql
* chore: fix CR comments
* chore: add location
* chore: by CR comments
* Update tests-integration/tests/sql.rs
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
* chore: remove the trace
---------
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
2023-06-20 04:07:28 +00:00
Ruihang Xia
903f02bf10
ci: optimize release progress ( #1794 )
...
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-06-20 11:39:53 +08:00
JeremyHi
1703e93e15
feat: add handler execution timer ( #1791 )
...
* feat: add handler execution timer
* fix: by cr
2023-06-20 11:25:13 +08:00
LFC
2dd86b686f
feat: extend region leases in Metasrv ( #1784 )
...
* feat: extend region leases in Metasrv
* fix: resolve PR comments
2023-06-19 19:55:59 +08:00
LFC
128c6ec98c
feat: region alive keeper in Datanode ( #1780 )
2023-06-19 14:50:33 +08:00
Lei, HUANG
960b84262b
fix: abort parquet writer ( #1785 )
...
* fix: sst file size
* fix: avoid creating file when no row's been written
* chore: rename tests
* fix: some clippy issues
* fix: some cr comments
2023-06-19 03:19:31 +00:00