Ruihang Xia
b27c569ae0
refactor: add scan_to_stream() to Table trait to postpone the stream generation ( #1639 )
...
* add scan_to_stream to Table
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* impl parquet stream
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* reorganise adapters
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* implement scan_to_stream for mito table
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* clean up
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add location info
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix: table scan
* UT pass
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* impl project record batch
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix information schema
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix clippy
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* resolve CR comments
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* remove one todo
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix errors generated by merge commit
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add output_ordering method to record batch stream
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix rustfmt
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* enhance error types
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: Lei, HUANG <mrsatangel@gmail.com >
2023-05-29 20:03:47 +08:00
Weny Xu
3dc45f1c13
feat: implement CloseRegionHandler ( #1569 )
...
* feat: implement CloseRegionHandler
* feat: register heartbeat response handlers
* test: add tests for heartbeat response handlers
* fix: drop table does not release regions
* chore: apply suggestion from CR
* fix: fix close region issue
* chore: apply suggestion from CR
* chore: apply suggestion from CR
* chore: apply suggestion from CR
* chore: apply suggestion from CR
* chore: apply suggestion from CR
* chore: apply suggestion from CR
* chore: apply suggestion from CR
* chore: modify method name and add log
* refactor: refactor HeartbeatResponseHandler
* chore: apply suggestion from CR
* refactor: remove close method from Region trait
* chore: apply suggestion from CR
* chore: remove PartialEq from CloseTableResult
* chore: apply suggestion from CR
2023-05-23 15:44:27 +08:00
Weny Xu
9f67ad8bce
fix: fix doesn't release closed regions issue ( #1596 )
...
* fix: fix close region issue
* chore: apply suggestion from CR
* chore: apply suggestion from CR
* chore: apply suggestion from CR
* chore: apply suggestion from CR
* refactor: remove close method from Region trait
* chore: remove PartialEq from CloseTableResult
2023-05-23 11:40:12 +08:00
Lei, HUANG
8e7ec4626b
refactor: remove useless error ( #1624 )
...
* refactor: remove useless
* fix: remove useless error variant
2023-05-22 22:55:27 +08:00
Weny Xu
66903d42e1
feat: implement OpenTableHandler ( #1567 )
...
* feat: implement OpenTableHandler
* chore: apply suggestion from CR
* chore: apply suggestion from CR
2023-05-15 10:47:28 +08:00
Yingwen
51be35a7b1
feat(mito): Combine the original and procedure's implementation ( #1468 )
...
* fix(mito): Add metrics to mito DDL procedure
* feat(mito): Use procedure's implementation to create table
* feat(mito): Use procedure's implementation to alter table
* feat(mito): Use procedure's implementation to drop table
* style(mito): Fix clippy
* test(mito): Fix tests
* feat(mito): Add TableCreator
* feat(mito): update alter table procedure
* fix(mito): alter procedure create alter op first
* feat(mito): Combine alter table code
* fix(mito): Fix deadlock
* feat(mito): Simplify drop table procedure
2023-04-28 11:48:52 +08:00
Weny Xu
a709a5c842
feat: support to create parquet format external table ( #1463 )
...
* feat: support parquet format external table
* Update src/file-table-engine/src/error.rs
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
---------
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
2023-04-26 16:45:37 +08:00
Weny Xu
f2167663b2
feat: support to create external table ( #1372 )
...
* feat: support to create external table
* chore: apply suggestions from CR
* test: add create external table without ts type
* chore: apply suggestions from CR
* fix: fix import typo
* refactor: move consts to table crate
* chore: apply suggestions from CR
* refactor: rename create_table_schema
2023-04-24 14:43:12 +08:00
Weny Xu
22b5a94d02
feat: support creating the physical plan for JSON and CSV files ( #1424 )
...
* feat: support creating the physical plan for JSON and CSV files
* chore: apply suggestions from CR
* chore: apply suggestions from CR
* refactor(file-table-engine): use datasource Format instead
2023-04-24 10:17:11 +08:00
Yingwen
9cd2cf630d
feat: procedures for file table engine ( #1417 )
...
* refactor: Add table_ref() to requests as their methods
* feat: Add CreateImmutableFileTable
* feat: Add DropImmutableFileTable
* feat: Implement TableEngineProcedure for ImmutableFileTableEngine
* feat: Add common-procedure-test crate
* refactor: mito engine use common-procedure-test to test procedures
* test: Add test for create and drop table
* chore: Address review comments
2023-04-20 18:52:44 +08:00
Weny Xu
a90798a2c1
test: add tests for file table engine ( #1353 )
...
* test: add tests for file table engine
* test: refactor open table test and add close engine test
2023-04-11 06:25:08 +00:00
Weny Xu
29c6155ae3
feat: introduce file table engine ( #1323 )
...
* feat: introduce file table engine
* chore: apply cr suggestions
* refactor: refactor immutable manifest
* chore: apply cr suggestions
* refactor: refactor immutable manifest
* chore: apply suggestions from code review
Co-authored-by: dennis zhuang <killme2008@gmail.com >
* chore: apply suggestions from CR
* chore: apply suggestions from code review
Co-authored-by: Lei, HUANG <6406592+v0y4g3r@users.noreply.github.com >
---------
Co-authored-by: dennis zhuang <killme2008@gmail.com >
Co-authored-by: Lei, HUANG <6406592+v0y4g3r@users.noreply.github.com >
2023-04-10 12:03:36 +08:00