LFC
dc52a51576
chore: upgrade to Arrow 29.0 and use workspace package and dependencies ( #782 )
...
* chore: upgrade to Arrow 29.0 and use workspace package and dependencies
* fix: resolve PR comments
Co-authored-by: luofucong <luofucong@greptime.com >
2022-12-23 14:28:37 +08:00
LFC
ea9af42091
chore: upgrade Rust to nightly 2022-12-20 ( #772 )
...
* chore: upgrade Rust to nightly 2022-12-20
* chore: upgrade Rust to nightly 2022-12-20
Co-authored-by: luofucong <luofucong@greptime.com >
2022-12-21 19:32:30 +08:00
Ning Sun
539ead5460
feat: check database existence on http api ( #764 )
...
* feat: check database existance on http api
* Update src/servers/src/http/handler.rs
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
* feat: use database not found status code
* test: add assertion for status code
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
2022-12-21 10:28:45 +08:00
Ning Sun
ea1896493b
feat: allow multiple sql statements in query string ( #699 )
...
* feat: allow multiple sql statement in query string
* test: add a test for multiple statement call
* feat: add temprary workaround for standalone mode
* fix: resolve sql parser issue temporarily
* Update src/datanode/src/instance/sql.rs
Co-authored-by: Yingwen <realevenyag@gmail.com >
* fix: adopt new sql handler
* refactor: revert changes in query engine
* refactor: assume sql-statement 1-1 on datanode
* test: use frontend for integration test
* refactor: add statement execution api for explicit single statement call
* fix: typo
* refactor: rename query method
* test: add test case for error
* test: data type change adoption
* chore: add todo from review
* chore: remove obsolete comments
* fix: resolve resolve issues
Co-authored-by: Yingwen <realevenyag@gmail.com >
2022-12-16 19:50:20 +08:00
Jiachun Feng
66bca11401
refactor: remove optional from the protos ( #756 )
2022-12-16 15:47:51 +08:00
Lei, HUANG
0653301754
feat: replace arrow2 with official implementation 🎉 ( #753 )
...
* chore: kick off. change datafusion/arrow/parquet to target version
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* chore: replace one last datafusion dep
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* feat: arrow_array switch to arrow
* chore: update dep of binary vector
* chore: fix wrong merge commit
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* feat: Switch to datatypes2
* feat: Make recordbatch compile
* chore: sort Cargo.toml
* feat: Fix common::recordbatch compiler errors
* feat: Fix recordbatch test compiling issue
* fix: api crate (#708 )
* fix: rename ConcreteDataType::timestamp_millis_type to ConcreteDataType::timestamp_millisecond_type. fix other warnings regarding timestamp
* fix: revert changes in datatypes2
* fix: helper
* chore: delete datatypes based on arrow2
* feat: Fix some compiler errors in common::query (#710 )
* feat: Fix some compiler errors in common::query
* feat: test_collect use vectors api
* fix: common-query subcrate (#712 )
* fix: record batch adapter
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix error enum
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix: Fix common::query compiler errors (#713 )
* feat: Move conversion to ScalarValue to value.rs
* fix: Fix common::query compiler errors
This commit also make InnerError pub(crate)
* feat: Implements diff accumulator using WrapperType (#715 )
* feat: Remove usage of opaque error from common::recordbatch
* feat: Remove opaque error from common::query
* feat: Fix diff compiler errors
Now common_function just use common_query's Error and Result. Adds
a LargestType associated type to LogicalPrimitiveType to get the largest
type a logical primitive type can cast to.
* feat: Remove LargestType from NativeType trait
* chore: Update comments
* feat: Restrict Scalar::RefType of WrapperType to itself
Add trait bound `for<'a> Scalar<RefType<'a> = Self>` to WrapperType
* chore: Address CR comments
* chore: Format codes
* fix: fix compile error for mean/polyval/pow/interp ops
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* Revert "fix: fix compile error for mean/polyval/pow/interp ops"
This reverts commit fb0b4eb826#716 )
* fix: Fix compiler errors in argmax/rate/median/norm_cdf
* chore: Address CR comments
* fix: fix compile error for mean/polyval/pow/interp ops (#717 )
* fix: fix compile error for mean/polyval/pow/interp ops
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* simplify type bounds
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix: fix argmin/percentile/clip/interp/scipy_stats_norm_pdf errors (#718 )
fix: fix argmin/percentile/clip/interp/scipy_stats_norm_pdf compiler errors
* fix: fix other compile error in common-function (#719 )
* further fixing
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix all compile errors in common function
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix: Fix tests and clippy for common-function subcrate (#726 )
* further fixing
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix all compile errors in common function
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix tests
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix clippy
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* revert test changes
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix: row group pruning (#725 )
* fix: row group pruning
* chore: use macro to simplify stats implemetation
* fxi: CR comments
* fix: row group metadata length mismatch
* fix: simplify code
* fix: Fix common::grpc compiler errors (#722 )
* fix: Fix common::grpc compiler errors
This commit refactors RecordBatch and holds vectors in the RecordBatch
struct, so we don't need to cast the array to vector when doing
serialization or iterating the batch.
Now we use the vector API instead of the arrow API in grpc crate.
* chore: Address CR comments
* fix common record batch
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix: Fix compile error in server subcrate (#727 )
* fix: Fix compile error in server subcrate
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* remove unused type alias
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* explicitly panic
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* Update src/storage/src/sst/parquet.rs
Co-authored-by: Yingwen <realevenyag@gmail.com >
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: Yingwen <realevenyag@gmail.com >
* fix: Fix common grpc expr (#730 )
* fix compile errors
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* rename fn names
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix styles
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix wranings in common-time
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix: pre-cast to avoid tremendous match arms (#734 )
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* feat: upgrade storage crate to arrow and parquet offcial impl (#738 )
* fix: compile erros
* fix: parquet reader and writer
* fix: parquet reader and writer
* fix: WriteBatch IPC encode/decode
* fix: clippy errors in storage subcrate
* chore: remove suspicious unwrap
* fix: some cr comments
* fix: CR comments
* fix: CR comments
* fix: Fix compiler errors in catalog and mito crates (#742 )
* fix: Fix compiler errors in mito
* fix: Fix compiler errors in catalog crate
* style: Fix clippy
* chore: Fix use
* Merge pull request #745
* fix nyc-taxi and util
* Merge branch 'replace-arrow2' into fix-others
* fix substrait
* fix warnings and error in test
* fix: Fix imports in optimizer.rs
* fix: errors in optimzer
* fix: remove unwrap
* fix: Fix compiler errors in query crate (#746 )
* fix: Fix compiler errors in state.rs
* fix: fix compiler errors in state
* feat: upgrade sqlparser to 0.26
* fix: fix datafusion engine compiler errors
* fix: Fix some tests in query crate
* fix: Fix all warnings in tests
* feat: Remove `Type` from timestamp's type name
* fix: fix query tests
Now datafusion already supports median, so this commit also remove the
median function
* style: Fix clippy
* feat: Remove RecordBatch::pretty_print
* chore: Address CR comments
* Update src/query/src/query_engine/state.rs
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
* fix: frontend compile errors (#747 )
fix: fix compile errors in frontend
* fix: Fix compiler errors in script crate (#749 )
* fix: Fix compiler errors in state.rs
* fix: fix compiler errors in state
* feat: upgrade sqlparser to 0.26
* fix: fix datafusion engine compiler errors
* fix: Fix some tests in query crate
* fix: Fix all warnings in tests
* feat: Remove `Type` from timestamp's type name
* fix: fix query tests
Now datafusion already supports median, so this commit also remove the
median function
* style: Fix clippy
* feat: Remove RecordBatch::pretty_print
* chore: Address CR comments
* feat: Add column_by_name to RecordBatch
* feat: modify select_from_rb
* feat: Fix some compiler errors in vector.rs
* feat: Fix more compiler errors in vector.rs
* fix: fix table.rs
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix: Fix compiler errors in coprocessor
* fix: Fix some compiler errors
* fix: Fix compiler errors in script
* chore: Remove unused imports and format code
* test: disable interval tests
* test: Fix test_compile_execute test
* style: Fix clippy
* feat: Support interval
* feat: Add RecordBatch::columns and fix clippy
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
* fix: Fix All The Tests! (#752 )
* fix: Fix several tests compile errors
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix: some compile errors in tests
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix: compile errors in frontend tests
* fix: compile errors in frontend tests
* test: Fix tests in api and common-query
* test: Fix test in sql crate
* fix: resolve substrait error
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* chore: add more test
* test: Fix tests in servers
* fix instance_test
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* test: Fix tests in tests-integration
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: Lei, HUANG <mrsatangel@gmail.com >
Co-authored-by: evenyag <realevenyag@gmail.com >
* fix: clippy errors
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: evenyag <realevenyag@gmail.com >
2022-12-15 18:49:12 +08:00
LFC
61d8bc2ea1
refactor(frontend): minor changes around FrontendInstance constructor ( #748 )
...
* refactor: minor changes in some testing codes
Co-authored-by: luofucong <luofucong@greptime.com >
2022-12-15 14:34:40 +08:00
LFC
833216d317
refactor: directly invoke Datanode methods in standalone mode (part 1) ( #694 )
...
* refactor: directly invoke Datanode methods in standalone mode
* test: add more unit tests
* fix: get rid of `println` in testing codes
* fix: resolve PR comments
* fix: resolve PR comments
Co-authored-by: luofucong <luofucong@greptime.com >
2022-12-07 11:37:59 +08:00
dennis zhuang
6720bc5f7c
fix: validate create table request in mito engine ( #690 )
...
* fix: validate create table request in mito engine
* fix: comment
* chore: remove TIMESTAMP_INDEX in system.rs
2022-12-05 11:01:43 +08:00
Mofeng
13d51250ba
feat: add http /health api ( #676 )
...
* feat: add http `/health` api
* feat: add `/health` api test suit in http intergration test
2022-12-01 19:11:58 +08:00
dennis zhuang
2e17e9c4b5
feat: supports s3 storage ( #656 )
...
* feat: adds s3 object storage configuration
* feat: adds s3 integration test
* chore: use map
* fix: forgot license header
* fix: checking if bucket is empty in test_on
* chore: address CR issues
* refactor: run s3 test with dotenv
* chore: randomize grpc port for test
* fix: README in tests-integration
* chore: remove redundant comments
2022-12-01 10:59:14 +08:00
Dongxu Wang
6d24f7ebb6
refactor: bump axum 0.6, use recommended way to nest routes ( #668 )
2022-11-30 20:04:33 +08:00
Ning Sun
75dcf2467b
refactor: add tests-integration module ( #590 )
...
* refactor: add integration-tests module
* Apply suggestions from code review
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
* test: move grpc module to tests-integration
* test: adapt new standalone mode
* test: improve http assertion
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2022-11-29 16:28:58 +08:00
