Bohan Wu
ba3ce436df
refactor(SST): UUID as id in FileMeta ( #1116 )
...
* feat(SST): use a newType named FileId for FileMeta
* chore: rename some functions
* fix: compatible for previous FileMeta format
* fix: alias for file_id when getting deserialized
2023-03-08 14:27:20 +08:00
Eugene Tolbakov
b31a6cb506
refactor: replace tempdir with tempfile ( #1123 )
...
* refactor: replace tempdir with tempfile
* refactor(query): move tempfile dependency under the workspace's Cargo.toml
* refactor(tempfile): create common-test-util
* refactor(tempfile): fix toml format
* refactor(tempfile): remove tempfile out of dependencies
* refactor(tempfile): fix incorrect toml
2023-03-08 11:15:56 +08:00
SSebo
95090592f0
feat: mysql prepare replacing sql placeholder to param ( #1086 )
...
* feat: mysql prepare by replace ? in sql to param
* chore: mysql prepare statment support time param
* chore: prepare test more types
* chore: add TODO
2023-03-08 11:02:29 +08:00
Ruihang Xia
3a527c0fd5
feat: impl proc macro range_fn and some aggr_over_time functions ( #1072 )
...
* impl range_fn proc macro
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* impl some aggr_over_time fn
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* impl present_over_time and absent_over_time
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* accomplish planner, and correct type cast
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* clean up
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* document the macro
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix styles
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update irate/idelta test
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add test cases
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix clippy
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-03-07 23:39:45 +08:00
elijah
819b60ca13
feat(datatypes): implement VectorOp::take ( #1115 )
...
* feat: add take index method for VectorOp
* chore: make clippy happy
* chore: make clippy happy
* chore: improve the code
* chore: improve the code
* chore: add take null test
* chore: fix clippy
2023-03-07 19:27:33 +08:00
Weny Xu
7169fe2989
feat: implement Copy From ( #1064 )
2023-03-07 17:54:11 +08:00
Zheming Li
b70672be77
feat: track disk usage of regions ( #1125 )
...
* feat: track disk usage of regions
Signed-off-by: Zheming Li <nkdudu@126.com >
* calculate disk usage when call
* add default on file meta
---------
Signed-off-by: Zheming Li <nkdudu@126.com >
2023-03-07 17:13:12 +08:00
Lei, HUANG
a4c01f4a3a
feat: memory profiling ( #1124 )
...
* feat: use jemalloc as default allocator
* feat: add feature for mem-prof
* feat: add errors
* make common-mem-prof optional dep
* fix: toml format
* doc: add profile doc
* fix: typo
2023-03-07 17:12:51 +08:00
Weny Xu
bd98a26cca
chore: bump greptime-proto to latest(ad01872) ( #1102 )
2023-03-07 10:52:42 +08:00
shuiyisong
1b4236d698
refactor: use split instead of serde_urlencoded in http auth ( #1110 )
...
* refactor: change from urlencoded to regex
* refactor: change from urlencoded to regex
* chore: add unit test
* chore: update comment
* chore: remove local benchmark test
* chore: minor fix
* chore: remove unused dep
2023-03-07 10:51:47 +08:00
Lei, HUANG
e8cc9b4b29
test: add manifest compatibility tests ( #1130 )
...
* tests: add manifest compatibility tests
* fix: clippy
2023-03-06 19:31:54 +08:00
discord9
379f581780
test: add Integrated Test for Coprocessor& fix minor bugs ( #1122 )
...
* feat: cache `Runtime`
* fix: coprstream schema not set
* test: integrated tests for Coprocessor
* fix: UDF fixed
* style: remove unused import
* chore: remove more unused import
* feat: `filter`, (r)floordiv for Vector
* chore: CR advices
* feat: auto convert to `lit`
* chore: fix typo
* feat: from&to `pyarrow.array`
* feat: allow `pyarrow.array` as args to builtins
* chore: cargo fmt
* test: CI add `pyarrow`
* test: install Python&PyArrow in CI
* test: not cache depend for now
* chore: CR advices
* test: fix name
* style: rename
2023-03-06 19:20:59 +08:00
fys
ff6cfe8e70
refactor: move the batch_get to KvStore trait ( #1029 )
...
* move batch_get from KvStoreExt to KvStore
* add some unit tests
* add some unit test
* add some unit tests
* expose batch_get grpc method
2023-03-06 17:35:43 +08:00
Igor Morozov
5a397917c0
docs(contributingmd): add run tests commands ( #1129 )
...
* docs(contributingmd): add run tests commands
* docs(contributingmd): add link to nextest website
Co-authored-by: dennis zhuang <killme2008@gmail.com >
---------
Co-authored-by: dennis zhuang <killme2008@gmail.com >
2023-03-06 15:54:16 +08:00
fys
559880cb84
fix: can not find catalog when create table ( #1118 )
...
* fix: get catalog by name in RemoteCatalogManager
* cr
* cr
* cr
* fix: ut failed
2023-03-06 14:44:40 +08:00
Ruihang Xia
b76b27f3bf
refactor: try to remove unnecessary tests in error mod ( #750 )
...
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-03-06 12:31:30 +08:00
yuanbohan
d4e0dc3685
feat: specify prom server start addr ( #1111 )
...
* feat: specify promql server start addr
* refactor: rename promql to prom in Prometheus API server scenario
2023-03-06 11:07:21 +08:00
Eugene Tolbakov
b022556b79
fix: apply ttl and write_buffer_size options when a table is created via procedure ( #1117 )
...
* fix: apply ttl and write_buffer_size options when a table is created via procedure
* fix: address code review suggestion
* fix: use borrowing of table_options correctly
v0.1.0-alpha-20230306-weekly
2023-03-05 19:37:23 +08:00
shuiyisong
bd065ea6e8
fix: remove incorrect continue ( #1114 )
2023-03-02 19:52:17 +08:00
yuanbohan
9a87f5edf8
fix(grpc): support timestamp precision ( #1113 )
2023-03-02 17:33:59 +08:00
Weny Xu
e851b6d019
feat: implement Copy From parser ( #1092 )
...
* feat: implement Copy From parser
* Apply suggestions from code review
Co-authored-by: Yingwen <realevenyag@gmail.com >
---------
Co-authored-by: Lei, HUANG <6406592+v0y4g3r@users.noreply.github.com >
Co-authored-by: Yingwen <realevenyag@gmail.com >
2023-03-02 14:03:13 +08:00
Ruihang Xia
e7b92f24e8
feat: impl EmptyMetric plan and time() function ( #1100 )
...
* impl EmptyMetric plan
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add test cases
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* impl planner part
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* adapt new datafusion changes
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix typo
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-03-02 03:15:55 +00:00
Igor Morozov
4b8db408cf
style(contributingmd): fix markdown issues and typos ( #1107 )
...
* style(contributingmd): fix markdown issues and typos
* style(contributingmd): remove code blocks in lists
2023-03-01 20:00:36 +08:00
Yingwen
98659899c0
refactor: Move mito engine tests to a separate file ( #1104 )
...
* refactor(mito): Move tests to a separate file
* chore(query): Remove empty mod function
2023-03-01 11:46:39 +00:00
Ruihang Xia
b1311801da
ci: update breaking-change labeler ( #1109 )
...
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-03-01 19:24:21 +08:00
Yingwen
f1b65d9b77
test: fix datanode::test_read_from_config_file ( #1106 )
...
* test: Fix datanode::test_read_from_config_file
* test: frontend and metasrv don't read example toml file
2023-03-01 18:31:40 +08:00
Ruihang Xia
d5a2a26916
chore(deps): bump sqlness to v0.4 ( #1101 )
...
deps: bump sqlness to v0.4
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-03-01 17:27:16 +08:00
Ning Sun
8e7e68708f
docs: correct readme format ( #1105 )
...
* docs: correct readme format
* ci: fix config name
2023-03-01 16:59:11 +08:00
Ruihang Xia
9c1118b06d
ci: adjust title labeler's rule ( #1079 )
...
* ci: adjust title labeler's rule
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* Apply suggestions from code review
Co-authored-by: Yingwen <realevenyag@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: Yingwen <realevenyag@gmail.com >
2023-03-01 15:16:21 +08:00
Yingwen
3fb93efbd0
docs: Document fields in the config examples ( #1098 )
...
* docs: Add comments to standalone config example
* docs: Add comments to datanode config example
* docs: Add comments to frontend config example
* docs: Add comments to meta-srv config example
* docs: Use "GB" instead of "GiB"
* docs: Add link to the selector doc
* docs: Fix grammar
2023-03-01 15:14:08 +08:00
Yingwen
3fd9c2f144
feat: Store error in procedure state ( #1062 )
...
* docs: Change comment position
* refactor(procedure): Store error in ProcedureState
* test: Mock instance with procedure enabled
* feat: Add wait method to wait for procedure
* test(datanode): Test create table by procedure
* chore: Fix clippy
2023-03-01 14:37:50 +08:00
Ning Sun
75e48c5f20
ci: fix apidoc generation
2023-03-01 14:09:47 +08:00
Ning Sun
d402f83442
ci: generate apidocs when pushing to default branch ( #1093 )
...
* ci: generate apidocs when pushing to default branch
* ci: require clippy before running tests
* fix: resolve new clippy warnings on primitive slice
* fix: resolve more clippy warnings
* Update .github/workflows/apidoc.yml
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
* ci: add an index html to redirect
---------
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
2023-03-01 13:18:26 +08:00
discord9
c5c6494e0b
feat: add PyO3(Hence CPython as a Optional Backend ( #976 )
...
* refactor: ffi_types
* style: fmt
* refactor: use `String` for return when possible
* todo: vector_impl
* feat: pyobj_try_typed_val
* refactor: more backend indep function
* feat: +-*/ magic methods
* refactor: copr
* style: fmt
* feat: add paired tests
* refactor: more
* refactor: move inside `python` folder
* refactor: all but test code
* feat: builtins for PyO3
* chore: add licenses
* chore: remove unused&add todos
* refactor: remove old files
* chore: mark unused
* chore: fmt
* chore: license
* feat: query in PyO3
* test: paired testcases for rspy&pyo3
* feat: PyDataFrame(Untested)
* feat: some allow_threads
* style: fmt
* style: add license
* feat: rebase manually of #962
* feat: more `allow_threads`
* chore: typo
* chore: remove some `TODO`
* test: allow margin of epsilon
* chore: code review advices
* chore: more CR adjust
* chore: more adjust
* feat: kwargs&its test
* chore: remove some `dbg!`
* chore: allow params
* fix: put `dataframe` into scope
* chore: newline
* fix: adjust after rebase
* fix: test serde skip attr
* style: taplo
* feat: add `pyo3_backend` feature
* doc: update CI&readme
2023-03-01 10:45:55 +08:00
shuiyisong
dc50095af3
fix: use catalog from connection ( #1099 )
...
* fix: using schema instead of full database
* fix: using schema instead of full database
* fix: using schema instead of full database
* chore: add debug log
* chore: remove debug log
* chore: remove debug log
* chore: fix cr
2023-03-01 10:34:57 +08:00
LFC
8cd69f441e
feat: REPL issues logical plan to DB ( #1097 )
2023-02-28 16:59:48 +08:00
Weny Xu
f52fc9b7d4
fix: fix panic when the root is not specified ( #1089 )
2023-02-28 10:54:52 +08:00
shuiyisong
50d2685365
fix: fix catalog parsing issue ( #1091 )
...
fix: try fix catalog parsing issue
2023-02-27 22:51:49 +08:00
LFC
11d45e2918
refactor: upgrade DataFusion, Arrow and Sqlparser ( #1074 )
...
* refactor: upgrade DataFusion, Arrow and Sqlparser
* fix: resolve PR comments
2023-02-27 22:20:08 +08:00
shuiyisong
30287e7e41
fix: continue if parsing err catalog ( #1090 )
...
* fix: continue if parsing err catalog
* fix: change from warn to error
2023-02-27 11:28:45 +00:00
Xieqijun
0b3f955ca7
feat: Add an error variant RetryLater ( #1058 )
...
* feat: support retry error
* fix: ci
* fix: ci
* fix: fmt
* feat: add convert procedure error
* Docs : add rustdoc
* fix: cr
* fix: cr
* fix: rm unless code
v0.1.0-alpha-20230227-weekly
2023-02-27 17:19:37 +08:00
Ning Sun
4b58a8a18d
feat: update substrait and prost version ( #1080 )
2023-02-27 15:18:12 +08:00
Yingwen
bd377ef329
feat: Procedure to create table and register table to catalog ( #1040 )
...
* feat: Add table-procedures crate
* feat: Implement procedure to create table
* feat: Integrate procedure manager to datanode
* test: Test CreateTableProcedure
* refactor: Rename table-procedures to table-procedure
* feat: Implement create_table_by_procedure
* chore: Remove comment
* chore: Add todo
* feat: Add procedure config to standalone mode
* feat: Register table-procedure loaders
* feat: Address review comments
CreateTableProcedure just return error if the subprocedure is failed
* chore: Address CR comments
2023-02-27 11:49:23 +08:00
LFC
df751c38b4
feat: a simple REPL for debugging purpose ( #1048 )
...
* feat: a simple REPL for debugging purpose
* fix: rebase develop
2023-02-27 11:00:15 +08:00
Yingwen
f6e871708a
chore: Rename MetaClientOpts to MetaClientOptions ( #1075 )
...
* fix: Serialize FrontendOptions to toml
* fix: Serialize DatanodeOptions to toml
* fix: Serialize StandaloneOptions to toml
See https://users.rust-lang.org/t/why-toml-to-string-get-error-valueaftertable/85903/2
* chore!: Rename MetaClientOpts to MetaClientOptions
BREAKING CHANGE: Change the meta_client_opts in the config file to
meta_client_options
2023-02-24 16:28:38 +08:00
fys
819c990a89
fix: thread that reports the heartbeat panics in unit test ( #1078 )
...
fix: ut panic in heartbeat report thread
2023-02-24 15:36:32 +08:00
Ruihang Xia
a8b4e8d933
ci: simplify codecov commment ( #1073 )
...
chore(ci): simplify codecov commment
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-02-24 15:22:57 +08:00
Yingwen
710e2ed133
ci: Use fixed skywalking-eyes revision ( #1076 )
...
The latest PR of skywalking-eyes https://github.com/apache/skywalking-eyes/pull/149
breaks our CI action
2023-02-24 07:05:18 +00:00
Ning Sun
81eab74b90
refactor: remove grpc client constructor with default catalog/schema ( #1060 )
...
* refactor: remove grpc client with default catalog/schema
* refactor: re-export consts in client module
2023-02-24 11:06:14 +08:00
Ning Sun
8f67d8ca93
fix: update mysql server library to fix tls corrupt messsage issue ( #1065 )
2023-02-24 10:20:44 +08:00