Commit Graph

1178 Commits

Author SHA1 Message Date
shuiyisong
a57cd604c1 chore: remove table scan timer 2023-06-25 17:46:54 +08:00
shuiyisong
c2c5801156 chore: try using df_plan.metrics() 2023-06-25 17:10:00 +08:00
shuiyisong
4945d6682d chore: minor update 2023-06-25 16:53:29 +08:00
shuiyisong
85f9c8368f chore: merge develop 2023-06-25 16:42:43 +08:00
Yingwen
fd412b7b07 refactor!: Uses table id to locate tables in table engines (#1817)
* refactor: add table_id to get_table()/table_exists()

* refactor: Add table_id to alter table request

* refactor: Add table id to DropTableRequest

* refactor: add table id to DropTableRequest

* refactor: Use table id as key for the tables map

* refactor: use table id as file engine's map key

* refactor: Remove table reference from engine's get_table/table_exists

* style: remove unused imports

* feat!: Add table id to TableRegionalValue

* style: fix cilppy

* chore: add comments and logs
2023-06-25 15:05:20 +08:00
Weny Xu
223cf31409 feat: support to copy from orc format (#1814)
* feat: support to copy from orc format

* test: add copy from orc test

* chore: add license header

* refactor: remove unimplemented macro

* chore: apply suggestions from CR

* chore: bump orc-rust to 0.2.3
2023-06-25 14:07:16 +08:00
Ruihang Xia
62f660e439 feat: implement metrics for Scan plan (#1812)
* add metrics in some interfaces

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

* calc elapsed time and rows

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

---------

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>
2023-06-25 14:06:50 +08:00
shuiyisong
501b1940f3 chore: add timer to ready poll 2023-06-25 12:34:50 +08:00
shuiyisong
138032672d chore: add back stream metrics wrapper 2023-06-25 12:04:52 +08:00
shuiyisong
be1156bf7b chore: remove timer in scan batch 2023-06-25 11:20:58 +08:00
Lei, HUANG
0fb18245b8 fix: docker build (#1822) 2023-06-25 11:05:46 +08:00
Weny Xu
caed6879e6 refactor: remove redundant code (#1821) 2023-06-25 10:56:31 +08:00
shuiyisong
1368ac853a chore: merge table scan metrics 2023-06-23 14:44:47 +08:00
Ruihang Xia
7ddfa9d3e4 calc elapsed time and rows
Signed-off-by: Ruihang Xia <waynestxia@gmail.com>
2023-06-23 14:35:45 +08:00
Ruihang Xia
5e06be51e4 add metrics in some interfaces
Signed-off-by: Ruihang Xia <waynestxia@gmail.com>
2023-06-23 14:35:45 +08:00
Yingwen
5ab0747092 test(storage): wait task before checking scheduled task num (#1811) v0.3.1-nightly-20230621 2023-06-21 18:04:34 +08:00
Ruihang Xia
b1ccc7ef5d fix: prevent filter pushdown in distributed planner (#1806)
* fix: prevent filter pushdown in distributed planner

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

* fix metadata

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

---------

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>
2023-06-21 16:25:50 +08:00
Lei, HUANG
d1b5ce0d35 chore: check catalog deregister result (#1810)
* chore: check deregister result and return error on failure

* refactor: SystemCatalog::deregister_table returns Result<()>
2023-06-21 08:09:11 +00:00
Lei, HUANG
a314993ab4 chore: change logstore default config (#1809) 2023-06-21 07:34:24 +00:00
LFC
fa522bc579 fix: drop region alive countdown tasks when deregistering table (#1808) 2023-06-21 14:49:32 +08:00
Lei, HUANG
5335203360 feat: support cross compilation to aarch64 linux (#1802) 2023-06-21 14:08:45 +08:00
Ruihang Xia
23bf55a265 fix: __field__ matcher on single value column (#1805)
* fix error text and field_column_names

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

* add sqlness test

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

* add empty line

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

* improve style

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

---------

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>
2023-06-21 10:59:58 +08:00
Eugene Tolbakov
3b91fc2c64 feat: add initial implementation for status endpoint (#1789)
* feat: add initial implementation for status endpoint

* feat(status_endpoint): add more data to response

* feat(status_endpoint): use build data env vars

* feat(status_endpoint): add simple test

* fix(status_endpoint): adjust the toml indentation
2023-06-21 10:50:08 +08:00
LFC
6205616301 fix: filter table regional values with the current node id (#1800) v0.4.0-nightly-20230621 v0.4.0-nightly-20230620 2023-06-20 19:17:35 +08:00
JeremyHi
e47ef1f0d2 chore: minor fix (#1801) 2023-06-20 11:03:52 +00:00
Lei, HUANG
16c1ee2618 feat: incremental database backup (#1240)
* feat: incremental database backup

* chore: rebase develop

* chore: move backup to StatementExecutor

* feat: copy database parser

* chore: remove some todos

* chore: use timestamp string instead of i64 string

* fix: typo
2023-06-20 18:26:55 +08:00
shuiyisong
c9937233cd chore: merge develop 2023-06-20 18:00:06 +08:00
JeremyHi
323e2aed07 feat: deal with more than 128 txn (#1799) 2023-06-20 17:56:45 +08:00
shuiyisong
c1225f23fb chore: add create table backup time 2023-06-20 17:17:00 +08:00
shuiyisong
d43f6042a4 Revert "chore: try shrink"
This reverts commit 0361b51670.
2023-06-20 16:22:00 +08:00
LFC
cbc2620a59 feat: start region alive keepers (#1796)
* feat: start region alive keepers
2023-06-20 15:45:29 +08:00
shuiyisong
0361b51670 chore: try shrink 2023-06-20 15:39:06 +08:00
JeremyHi
4fdee5ea3c feat: deal with node epoch (#1795)
* feat: deal with node epoch

* feat: dn send node_epoch

* Update src/meta-srv/src/handler/persist_stats_handler.rs

Co-authored-by: dennis zhuang <killme2008@gmail.com>

* Update src/meta-srv/src/service/store/ext.rs

Co-authored-by: dennis zhuang <killme2008@gmail.com>

* chore: by cr

---------

Co-authored-by: dennis zhuang <killme2008@gmail.com>
2023-06-20 07:07:05 +00:00
shuiyisong
f2dd677501 chore: add etcd batch size warn 2023-06-20 15:06:29 +08:00
shuiyisong
8ed834b343 chore: shrink keep lease handler buffer 2023-06-20 15:02:50 +08:00
dennis zhuang
30472cebae feat: prepare supports caching logical plan and infering param types (#1776)
* feat: change do_describe function signature

* feat: infer param type and cache logical plan for msyql prepared statments

* fix: convert_value

* fix: forgot helper

* chore: comments

* fix: typo

* test: add more tests and test date, datatime in mysql

* chore: fix CR comments

* chore: add location

* chore: by CR comments

* Update tests-integration/tests/sql.rs

Co-authored-by: Ruihang Xia <waynestxia@gmail.com>

* chore: remove the trace

---------

Co-authored-by: Ruihang Xia <waynestxia@gmail.com>
2023-06-20 04:07:28 +00:00
shuiyisong
f1983f9131 chore: add retry in create table 2023-06-20 11:47:21 +08:00
Ruihang Xia
903f02bf10 ci: optimize release progress (#1794)
Signed-off-by: Ruihang Xia <waynestxia@gmail.com>
2023-06-20 11:39:53 +08:00
JeremyHi
1703e93e15 feat: add handler execution timer (#1791)
* feat: add handler execution timer

* fix: by cr
2023-06-20 11:25:13 +08:00
shuiyisong
8bc28313d3 chore: minor comment fix 2023-06-20 10:52:55 +08:00
shuiyisong
fd37d4630c chore: impl metrics method on df execution plan adapter 2023-06-20 10:47:10 +08:00
shuiyisong
5b3b2a6faf chore: remove unused code 2023-06-20 10:47:10 +08:00
shuiyisong
5e36611d44 chore: update meter-core version 2023-06-20 10:47:10 +08:00
shuiyisong
03052fedf5 chore: add metrics method 2023-06-20 10:47:10 +08:00
shuiyisong
754a4fe256 test: add plugins to datanode initialization 2023-06-20 10:47:10 +08:00
shuiyisong
b39682075e test: add plugins to datanode initialization 2023-06-20 10:47:10 +08:00
shuiyisong
91456daf99 test: add physical plan wrapper trait 2023-06-20 10:47:10 +08:00
LFC
2dd86b686f feat: extend region leases in Metasrv (#1784)
* feat: extend region leases in Metasrv

* fix: resolve PR comments
2023-06-19 19:55:59 +08:00
LFC
128c6ec98c feat: region alive keeper in Datanode (#1780) 2023-06-19 14:50:33 +08:00
Lei, HUANG
960b84262b fix: abort parquet writer (#1785)
* fix: sst file size

* fix: avoid creating file when no row's been written

* chore: rename tests

* fix: some clippy issues

* fix: some cr comments
2023-06-19 03:19:31 +00:00