Ruihang Xia
d82a3a7d58
feat: implement most of scalar function and selection conversion in substrait ( #678 )
...
* impl to_df_scalar_function
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* part of scalar functions
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* conjunction over filters
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* change the ser/de target to substrait::Plan
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* basic test coverage
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix typos and license header
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix clippy
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix CR comments
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* logs unsupported extension
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* Update src/common/substrait/src/df_expr.rs
Co-authored-by: Yingwen <realevenyag@gmail.com >
* address review comments
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* change format
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* replace context with with_context
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: Yingwen <realevenyag@gmail.com >
2022-12-02 14:46:05 +08:00
Ning Sun
0599465685
feat: inject current database/schema into query context for postgres protocol ( #685 )
...
* feat: inject current database/schema into query context
* test: avoid duplicate server setup
2022-12-02 11:49:39 +08:00
Mofeng
13d51250ba
feat: add http /health api ( #676 )
...
* feat: add http `/health` api
* feat: add `/health` api test suit in http intergration test
2022-12-01 19:11:58 +08:00
LFC
6127706b5b
feat: support "use" stmt part 1 ( #672 )
...
* feat: a bare sketch of session; support "use" in MySQL server; modify insertion and selection related codes in Datanode
2022-12-01 17:05:32 +08:00
dennis zhuang
2e17e9c4b5
feat: supports s3 storage ( #656 )
...
* feat: adds s3 object storage configuration
* feat: adds s3 integration test
* chore: use map
* fix: forgot license header
* fix: checking if bucket is empty in test_on
* chore: address CR issues
* refactor: run s3 test with dotenv
* chore: randomize grpc port for test
* fix: README in tests-integration
* chore: remove redundant comments
2022-12-01 10:59:14 +08:00
Dongxu Wang
6d24f7ebb6
refactor: bump axum 0.6, use recommended way to nest routes ( #668 )
2022-11-30 20:04:33 +08:00
SSebo
68c2de8e45
feat: mysql and pg server support tls ( #641 )
...
* feat: mysql and pg server support tls
* chore: replace opensrv-mysql to original
* chore: TlsOption is required but supply default value
* feat: mysql server support force tls
* chore: move TlsOption to servers
* test: mysql server disable / prefer / required tls mode
* test: pg server disable / prefer / required tls mode
* chore: add doc and remove no used code
* chore: add TODO and restore cargo linker config
2022-11-30 12:46:15 +08:00
Yingwen
a17dcbc511
chore: fix SequenceNotMonotonic error message ( #664 )
...
* chore: fix SequenceNotMonotonic error message
previous sequence should greater than or equal to given sequence
* Apply suggestions from code review
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
2022-11-30 11:58:43 +08:00
LFC
020b9936cd
fix: correctly detach spawned mysql listener task ( #657 )
...
Co-authored-by: luofucong <luofucong@greptime.com >
2022-11-29 18:39:18 +08:00
Ning Sun
75dcf2467b
refactor: add tests-integration module ( #590 )
...
* refactor: add integration-tests module
* Apply suggestions from code review
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
* test: move grpc module to tests-integration
* test: adapt new standalone mode
* test: improve http assertion
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2022-11-29 16:28:58 +08:00
dennis zhuang
fdc73fb52f
perf: cache python interpreter in TLS ( #649 )
...
* perf: cache python interpreter when executing coprocessors
* test: speedup test_execute_script by reusing interpreter
* fix: remove comment
* chore: use get_or_insert_with instead
2022-11-29 14:41:37 +08:00
Zheming Li
baef640fe3
feat: add --version command line option ( #632 )
...
* add version command line option
* use concat!
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
2022-11-28 17:07:17 +08:00
dennis zhuang
5fddb799f7
feat: enable atomic write for file object storage ( #643 )
...
* fix: remove opendal from catalog dependencies
* feat: enable atomic writing for fs service
2022-11-28 16:01:32 +08:00
Dongxu Wang
f372229b18
fix: append table id to table data dir ( #640 )
2022-11-28 10:53:13 +08:00
Xuanwo
4085fc7899
chore: Bump OpenDAL to v0.21.1 ( #639 )
...
* deps: Bump OpenDAL to v0.21.1
Signed-off-by: Xuanwo <github@xuanwo.io >
* Avoid using raw types when not needed
Signed-off-by: Xuanwo <github@xuanwo.io >
Signed-off-by: Xuanwo <github@xuanwo.io >
2022-11-27 10:18:39 +08:00
Ruihang Xia
30940e692a
feat: impl DROP TABLE on memory catalog based standalone mode ( #630 )
...
* feat: implement drop table for standalone mode
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update integration test
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* enhancement test
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2022-11-25 11:53:46 +08:00
Mike Yang
b371ce0f48
test: added tests for statements methods ( #622 )
...
* test: added tests for parse_column_default_constraint
* test: added test for sql_column_def_to_grpc_column_def
* refactor: remove hardcode in test
2022-11-25 11:35:06 +08:00
Lei, HUANG
ac7f52d303
fix: start datanode instance before frontend services ( #634 )
2022-11-25 11:25:57 +08:00
fys
c5b0d2431f
feat: remove InsertBatch in gRPC message ( #570 )
2022-11-24 14:04:48 +08:00
Lei, HUANG
4038dd4067
fix: add concurrency control for catalog manager ( #619 )
2022-11-24 11:10:33 +08:00
Dongxu Wang
8be0f05570
chore: able to config axum timeout in toml ( #624 )
2022-11-24 11:09:21 +08:00
Ruihang Xia
7b37e99a45
feat: deregister table for MemoryCatalogManager ( #620 )
...
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2022-11-24 09:36:27 +08:00
dennis zhuang
c09775d17f
feat: adds metrics, tracing and retry layer to object-store ( #621 )
2022-11-23 11:40:03 +08:00
Francis Du
4a9cf49637
feat: support explain syntax ( #546 )
2022-11-22 21:22:32 +08:00
Lei, HUANG
c144a1b20e
feat: impl alter table in distributed mode ( #572 )
2022-11-22 15:17:25 +08:00
Yingwen
0791c65149
refactor: replace some usage of MutableBitmap by BitVec ( #610 )
2022-11-21 17:36:53 +08:00
LFC
62fcb54258
fix: correctly open table when distributed datanode restart ( #576 )
...
Co-authored-by: luofucong <luofucong@greptime.com >
2022-11-21 15:15:14 +08:00
Lei, HUANG
2b6b979d5a
fix: remove datanode mysql options in standalone mode ( #595 )
2022-11-21 14:15:47 +08:00
Dongxu Wang
b6fa316c65
chore: correct typos ( #589 ) ( #592 )
2022-11-21 14:07:45 +08:00
Lei, HUANG
ca5734edb3
feat: disable mysql server on datande when running standalone mode ( #593 )
2022-11-21 12:12:26 +08:00
Mike Yang
5428ad364e
fix: make nullable as default when alter table ( #591 )
2022-11-21 12:11:19 +08:00
Ruihang Xia
f465040acc
feat: lazy evaluated record batch stream ( #573 )
...
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2022-11-18 21:42:10 +08:00
Yingwen
22ae983280
refactor: Use re-exported arrow mod from datatypes crate ( #571 )
2022-11-18 18:38:07 +08:00
Igor Morozov
e1f326295f
feat: implement DESCRIBE TABLE ( #558 )
...
Also need to support describe table in other catalog/schema
2022-11-18 16:34:00 +08:00
aievl
6d762aa9dc
feat: update mysql default listen port to 4406 ( #568 )
...
Co-authored-by: zhaozhenhang <zhaozhenhang@kuaishou.com >
2022-11-18 14:55:11 +08:00
Xuanwo
1f0b39cc8d
chore: Bump OpenDAL to v0.20 ( #569 )
...
Signed-off-by: Xuanwo <github@xuanwo.io >
2022-11-18 14:17:38 +08:00
dennis zhuang
f8788273d5
feat: drop column for alter table ( #562 )
...
* feat: drop column for alter table
* refactor: rename RemoveColumns to DropColumns
* test: alter table
* chore: error msg
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
* fix: test_parse_alter_drop_column
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
2022-11-17 23:00:16 +08:00
LFC
e7b4d2b9cd
feat: Implement table_info() for DistTable ( #536 ) ( #557 )
...
* feat: Implement `table_info()`` for `DistTable` (#536 )
* Update src/catalog/src/error.rs
Co-authored-by: Yingwen <1405012107@qq.com >
Co-authored-by: luofucong <luofucong@greptime.com >
Co-authored-by: Yingwen <1405012107@qq.com >
2022-11-17 18:40:58 +08:00
Lei, Huang
8faa6b0f09
refactor: start options ( #545 )
...
* refactor: config options for frontend/datanode/standalone
* chore: rename MetaClientOpts::metasrv_addr to MetaClientOpts::metasrv_addrs
* fix: clippy
* fix: change default meta-srv addr to 127.0.0.1:3002
2022-11-17 11:47:39 +08:00
Yingwen
55f18b5a0b
refactor: Rename table-engine to mito ( #539 )
...
* refactor: Rename table-engine to mito
* style: Format codes
* docs: Update mito engine comment
* docs: Explain what is mito in README
2022-11-16 18:19:29 +08:00
Lei, Huang
7b43f027f9
fix: respect node id and metasrv addr in config file ( #542 )
...
* fix: respect node id and metasrv addr in config file
* fix: fmt
* fix: unit test
2022-11-16 18:16:11 +08:00
fys
5e42eb5ec6
fix: field number of proto ( #541 )
2022-11-16 17:41:34 +08:00
LFC
872ac8058f
feat: distributed execute gRPC and Prometheus query in Frontend ( #520 )
...
* feat: distributed execute GRPC and Prometheus query in Frontend
* feat: distributed execute GRPC and Prometheus query in Frontend
* Apply suggestions from code review
Co-authored-by: Lei, Huang <6406592+v0y4g3r@users.noreply.github.com >
* feat: distributed execute GRPC and Prometheus query in Frontend
* fix: do not convert timestamp to string when converting logical plan to SQL
* fix: tests
* refactor: no mock
* refactor: 0.0.0.0 -> 127.0.0.1
* refactor: 0.0.0.0 -> 127.0.0.1
* refactor: 0.0.0.0 -> 127.0.0.1
Co-authored-by: luofucong <luofucong@greptime.com >
Co-authored-by: Lei, Huang <6406592+v0y4g3r@users.noreply.github.com >
2022-11-16 14:59:48 +08:00
SSebo
29ad16d048
chore: fix typo ( #524 )
2022-11-16 11:53:25 +08:00
Ning Sun
173a8f67a1
test: ignore empty s3 bucket ( #529 )
2022-11-16 11:35:12 +08:00
Ruihang Xia
7ba512980a
chore: add APACHE-2.0 license header ( #518 )
...
* feat: add license checker workflow
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix existing header
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* specify license for internal sub-crate
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix rustfmt
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2022-11-15 18:05:46 +08:00
dennis zhuang
6c6eeda429
refactor: options and sample configurations ( #514 )
...
* refactor: options and sample configurations
* chore: newline at end of file
* chore: format code
* chore: remove comment and set sample configurations to default values
* chore: use single quoted string in sample configuration files
2022-11-15 17:39:22 +08:00
Jiachun Feng
cabb55322b
fix: meta minor fix ( #513 )
...
* chore: fix metaclient example
* chore: initial sequece value
2022-11-15 16:38:05 +08:00
Ruihang Xia
1565c8d236
chore: specify import style in rustfmt ( #460 )
...
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2022-11-15 15:58:54 +08:00
dennis zhuang
102e512a0a
feat: enable freeze-stdlib feature in rust-python ( #511 )
2022-11-15 15:06:58 +08:00