discord9
a44fe627ce
feat: heartbeat task&peer lookup in proc ( #4179 )
...
* feat: herat beat task
* feat: use real flow peer allocator when building
* feat: add peer look up in ddl context
* fix: drop flow test
* refactor: per review(WIP)
* refactor: not check if is alive
* refactor: per review
* refactor: remove useless `reset`
* refactor: per bot advices
* refactor: alive peer
* chore: bot review
2024-06-24 15:06:33 +00:00
Zhenchi
07cbabab7b
feat(puffin): support lz4 compression for footer ( #4194 )
...
* feat(puffin): support lz4 compression for footer
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* address comments
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
---------
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
2024-06-24 11:39:03 +00:00
discord9
517917453d
fix(flow): fix call df func bug&sqlness test ( #4165 )
...
* tests: flow sqlness tests
* tests: WIP df func test
* fix: use schema before expand for transform expr
* tests: some basic flow tests
* tests: unit test
* chore: dep use rev not patch
* fix: wired sqlness error?
* refactor: per review
* fix: temp sqlness bug
* fix: use fixed sqlness
* fix: impl drop as async shutdown
* refactor: per bot's review
* tests: drop worker handler both sync/async
* docs: add rationale for test
* refactor: per review
* chore: fmt
2024-06-24 07:52:45 +00:00
Ruihang Xia
fce65c97e3
feat: make RegionScanner aware of PartitionRange ( #4170 )
...
* define PartitionRange
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add optimizer rule
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* implement interfaces
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* impl aggr stream
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add fallback method
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix tests
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix tests
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix typo
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update sqlness result
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add document and rename struct
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add more comments
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix typo
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2024-06-21 09:54:22 +00:00
Weny Xu
1e52ba325f
feat: introduce chaos crds ( #4173 )
...
feat: add chaos-mesh crds
2024-06-21 06:28:51 +00:00
Yohan Wal
b739c9fd10
feat: PREPARE and EXECUTE statement from mysql client ( #4125 )
...
* feat: prepare stmt in mysql client
* feat: execute stmt in mysql client
* fix: handle parameters properly
* refactor: use existing funcs to convert expr to scalar value
* refactor: use uuid strings as stmt_key for queries from COM_PREPARE packet
* refactor: take prepare and execute parser as submodule
* test: add unit test for converting expr to scalar value
* feat: deallocate stmt in mysql client
* chore: comments and duplicates
---------
Co-authored-by: dennis zhuang <killme2008@gmail.com >
2024-06-21 02:02:57 +00:00
Ruihang Xia
21c89f3247
perf: optimize RecordBatch to HttpOutput conversion ( #4178 )
...
* add benchmark
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* save 70ms
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add profiler
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* save 50ms
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* save 160ms
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* format toml file
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix license header
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix windows build
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2024-06-20 12:33:58 +00:00
LFC
cc2f7efb98
chore: bump datafusion version to fix last_value regression ( #4169 )
...
* chore: bump datafusion version to fix `last_value` regression
* fix: resolve PR comments
* fix ci
2024-06-19 07:47:17 +00:00
discord9
cd9705ccd7
feat(flow): support datafusion scalar function ( #4142 )
...
* chore: call df function types
* feat: RelationDesc to DfSchema
* refactor: use RelationDesc instead of Type
* chore: WIP get to phy expr
* feat: custom deserialize
* chore: fmt
* refactor: renaming to DfScalarFunction
* feat: eval df func(untested)
* fix: had to spawn a thread for calling async
* chore: per review advices
* tests: test df scalar function
2024-06-18 12:34:38 +00:00
Weny Xu
ea2d067cf1
feat: implement the OrderedBatchProducer ( #4134 )
...
* feat: implement the `OrderedBatchProducer`
* test: add test of cancel safety
* chore: apply suggestions from CR
* chore: apply suggestions from CR
* refactor: simplify the `BackgroundProducerWorker`
* feat: implement the OrderedBatchProducer v2
* refactor: switch to `OrderedBatchProducer`
* chore: rename to `MAX_FLUSH_QUEUE_SIZE`
* refactor: switch to `OrderedBatchProducerV2`
* refactor: remove `OrderedBatchProducerV1`
* test: add tests
* refactor: make config configurable
* refactor: minor refactor
* chore: remove unused code
* chore: remove `benchmarks` crate
* chore: update config doc
* chore: remove unused comment
* refactor: refactor client registry
* refactor: rename `max_batch_size` to `max_batch_bytes`
* chore: use constant value
* chore: ensure serialized meta < ESTIMATED_META_SIZE
* chore: apply suggestions from CR
* chore: remove the `CHANNEL_SIZE`
* chore: apply suggestions from CR
* fix: ensure serialized meta < ESTIMATED_META_SIZE
* chore: apply suggestions from CR
* chore: apply suggestions from CR
2024-06-18 07:20:01 +00:00
Jeremyhi
141d017576
feat: enable metasrv to accept flownode's heartbeats ( #4160 )
...
* feat: make metasrv can accept flownode's heartbeat
* chore: proto
2024-06-18 04:07:46 +00:00
LFC
f4a5a44549
refactor: make region manifest checkpoint ran in background ( #4133 )
...
* refactor: use in-database manifest as checkpoint instead of merging incremental files in object store
* refactor: make region manifest checkpoint ran in background
* reduce unnecessary metrics
* Update src/mito2/src/manifest/checkpointer.rs
Co-authored-by: Yingwen <realevenyag@gmail.com >
* resolve PR comments
* resolve PR comments
---------
Co-authored-by: Yingwen <realevenyag@gmail.com >
2024-06-17 03:47:18 +00:00
localhost
01e3a24cf7
feat: log ingestion support ( #4014 )
...
* chore: add log http ingester scaffold
* chore: add some example code
* chore: add log inserter
* chore: add log handler file
* chore: add pipeline lib
* chore: import log handler
* chore: add pipelime http handler
* chore: add pipeline private table
* chore: add pipeline API
* chore: improve error handling
* chore: merge main
* chore: add multi content type support for log handler
* refactor: remove servers dep on pipeline
* refactor: move define_into_tonic_status to common-error
* refactor: bring in pipeline 3eb890c551b8d7f60c4491fcfec18966e2b210a4
* chore: fix typo
* refactor: bring in pipeline a95c9767d7056ab01dd8ca5fa1214456c6ffc72c
* chore: fix typo and license header
* refactor: move http event handler to a separate file
* chore: add test for pipeline
* chore: fmt
* refactor: bring in pipeline 7d2402701877901871dd1294a65ac937605a6a93
* refactor: move `pipeline_operator` to `pipeline` crate
* chore: minor update
* refactor: bring in pipeline 1711f4d46687bada72426d88cda417899e0ae3a4
* chore: add log
* chore: add log
* chore: remove open hook
* chore: minor update
* chore: fix fmt
* chore: minor update
* chore: rename desc for pipeline table
* refactor: remove updated_at in pipelines
* chore: add more content type support for log inserter api
* chore: introduce pipeline crate
* chore: update upload pipeline api
* chore: fix by pr commit
* chore: add some doc for pub fn/struct
* chore: some minro fix
* chore: add pipeline version support
* chore: impl log pipeline version
* chore: fix format issue
* fix: make the LogicalPlan of a query pipeline sorted in desc order
* chore: remove some debug log
* chore: replacing hashmap cache with moak
* chore: fix by pr commit
* chore: fix toml format issue
* chore: update Cargo.lock
* chore: fix by pr commit
* chore: fix some issue by pr commit
* chore: add more doc for pipeline version
---------
Co-authored-by: shuiyisong <xixing.sys@gmail.com >
2024-06-14 17:03:30 +00:00
Weny Xu
54ca06ba08
chore: bump version to v0.8.2 ( #4141 )
2024-06-14 03:39:08 +00:00
LFC
5a6021e34f
refactor: remove substrait ser/de for region query in standalone ( #3812 )
...
* refactor: remove substrait serde for region query in standalone
* fix ci
* move QueryRequest to common-query
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* format code
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* format toml file
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* chore: format toml
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: Yingwen <realevenyag@gmail.com >
2024-06-11 09:33:47 +00:00
Ning Sun
587e99d806
fix: macro crate cannot be compiled alone ( #4130 )
...
* fix: macro crate cannot be compiled alone
* Update src/common/macro/Cargo.toml
Co-authored-by: Yingwen <realevenyag@gmail.com >
---------
Co-authored-by: tison <wander4096@gmail.com >
Co-authored-by: Yingwen <realevenyag@gmail.com >
2024-06-11 05:36:29 +00:00
Jeremyhi
4719569e4f
feat: support gRPC cancellation ( #4092 )
...
* feat: support cancellation
* chore: add unit test for cancellation
* chore: minor refactor
* feat: we do not need to spawn in distributed mode
---------
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
2024-06-06 08:27:25 +00:00
taobo
dd06e107f9
test: add fuzz tests for column data type alteration ( #4076 )
...
* feat: support make fuzz-stable in Makefile
* test: add fuzz tests for column data type alteration
* fix: optimize code by cr
2024-06-04 13:38:57 +00:00
LFC
c0aed1d267
feat: set global runtime size by config file ( #4063 )
...
* set global runtime size
* fix: resolve PR comments
* fix: log the whole option
* fix ci
* debug ci
* debug ci
---------
Co-authored-by: Weny Xu <wenymedia@gmail.com >
2024-06-04 10:03:33 +00:00
Weny Xu
a6269397c8
fix: fix EntityTooSmall issue ( #4100 )
...
* fix: fix EntityTooSmall issue
* chore(ci): add minio to coverage
* tests: add test for parquet writer
* chore: move tests to `common-datasource` crate
2024-06-04 08:43:33 +00:00
Weny Xu
b3a4362626
test: run test_flush_reopen_region and test_region_replay with KafkaLogStore ( #4083 )
...
* feat: add `LogStoreFactory` to `TestEnv`
* feat: add `multiple_log_store_factories` template
* test: run `test_flush_reopen_region` and `test_region_replay` with `KafkaLogStore`
* chore: move deps to workspace
* chore: apply suggestions from CR
2024-06-04 08:11:15 +00:00
shuiyisong
d1838fb28d
refactor: move define_into_tonic_status to common-error ( #4095 )
...
* chore: finish cherry-pick
* chore: remove unused code
2024-06-04 03:29:15 +00:00
Ruihang Xia
c2218f8be8
build(deps): bump datafusion 20240528 ( #4061 )
...
* build(deps): bump datafusion 20240528
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* another update
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update expected sqlness result
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix first/last value
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* reformat comment
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix remaining errors
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* revert toml format
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix pyo3 feature
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* remove dead code
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* Apply suggestions from code review
Co-authored-by: Jeremyhi <jiachun_feng@proton.me >
* format file
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: Jeremyhi <jiachun_feng@proton.me >
2024-06-01 14:03:00 +00:00
Jeremyhi
43afea1a9d
refactor!: remove the tableid in ddl response since tableids is enough ( #4080 )
...
* refactor: remove the tableid in ddl response since tableids is enough
* chore: upgrade proto
2024-05-31 06:41:53 +00:00
dennis zhuang
24612f62dd
feat: querying from view works ( #3952 )
...
* feat: querying from view works
* feat: use MemoryCatalogProviderList instead of DummyCatalogList
* refactor: revert src/query/src/dummy_catalog.rs
* chore: clean code
* fix: make clippy happy
* fix: toml format
* fix: sqlness
* fix: forgot files
* fix: make sqlness happy
* test: table source, serializer and decoder
* fix: fail to decode plan because of invalid table names
* test: adds more sqlness test for view
* chore: remove unused errors
* fix: comments
* fix: typo
* fix: invalidate view info cache after creating view successfully
* chore: apply suggestion
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
* chore: apply suggestion
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
* fix: compile error after rebeasing
* chore: style
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
* fix: don't export table_name in common-meta
* chore: change ViewInfo::new signature
* docs: leave a TODO for optimize param
---------
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
2024-05-30 21:45:56 +00:00
discord9
05751084e7
chore: bump to v0.8.1 ( #4055 )
2024-05-30 07:59:52 +00:00
tison
9dd6e033a7
refactor: move Database to client crate behind testing feature ( #4059 )
...
* refactor: move Database to client crate behind testing feature
Signed-off-by: tison <wander4096@gmail.com >
* partial move
Signed-off-by: tison <wander4096@gmail.com >
* catch up more
Signed-off-by: tison <wander4096@gmail.com >
* fix imports
Signed-off-by: tison <wander4096@gmail.com >
* finish
Signed-off-by: tison <wander4096@gmail.com >
* tidy
Signed-off-by: tison <wander4096@gmail.com >
---------
Signed-off-by: tison <wander4096@gmail.com >
2024-05-28 03:21:43 +00:00
tison
f9db5ff0d6
build(deps): upgrade opendal to 0.46 ( #4037 )
...
* build(deps): upgrade opendal to 0.46
Signed-off-by: tison <wander4096@gmail.com >
* migrate writes
Signed-off-by: tison <wander4096@gmail.com >
* migrate reads
Signed-off-by: tison <wander4096@gmail.com >
* fixup object safety
Signed-off-by: tison <wander4096@gmail.com >
* fixup names
Signed-off-by: tison <wander4096@gmail.com >
* fixup compilation
Signed-off-by: tison <wander4096@gmail.com >
* fixup compilation
Signed-off-by: tison <wander4096@gmail.com >
* a few Buffer to Vec
Signed-off-by: tison <wander4096@gmail.com >
* Make greptime buildable with opendal 0.46 (#5 )
Signed-off-by: Xuanwo <github@xuanwo.io >
* fixup toml check
Signed-off-by: tison <wander4096@gmail.com >
* test_orc_opener
Signed-off-by: tison <wander4096@gmail.com >
* Fix lru cache (#6 )
Signed-off-by: Xuanwo <github@xuanwo.io >
* clippy
Signed-off-by: tison <wander4096@gmail.com >
* improve comments
Signed-off-by: tison <wander4096@gmail.com >
* address comments
Signed-off-by: tison <wander4096@gmail.com >
* reduce buf copy
Signed-off-by: tison <wander4096@gmail.com >
* upgrade to reqwest 0.12
Signed-off-by: tison <wander4096@gmail.com >
---------
Signed-off-by: tison <wander4096@gmail.com >
Signed-off-by: Xuanwo <github@xuanwo.io >
Co-authored-by: Xuanwo <github@xuanwo.io >
2024-05-27 09:12:23 +00:00
Ruihang Xia
1de17aec74
feat: change EXPIRE WHEN to EXPIRE AFTER ( #4002 )
...
* feat: change EXPIRE WHEN to EXPIRE AFTER
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* change remaining
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* rename create_if_not_exist to create_if_not_exists
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* parse interval expr
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update comment
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* Apply suggestions from code review
Co-authored-by: Jeremyhi <jiachun_feng@proton.me >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: Jeremyhi <jiachun_feng@proton.me >
2024-05-27 04:05:55 +00:00
tison
3790020d78
build(deps): upgrade promql-parser to 0.4 ( #4047 )
...
* build(deps): upgrade promql-parser to 0.4
Signed-off-by: tison <wander4096@gmail.com >
* lock
Signed-off-by: tison <wander4096@gmail.com >
* catch up upgrades
Signed-off-by: tison <wander4096@gmail.com >
* concise method
Signed-off-by: tison <wander4096@gmail.com >
---------
Signed-off-by: tison <wander4096@gmail.com >
2024-05-27 01:51:59 +00:00
Lei, HUANG
090b59e8d6
feat: manual compaction ( #3988 )
...
* add compaction udf params
* wip: pass compaction options through grpc
* wip: pass compaction options all the way down to region server
* wip: window compaction task
* feat: trigger major compaction
* refactor: optimize compaction parameter parsing
* chore: rebase main
* chore: update proto
* chore: add some tests
* feat: validate catalog
* chore: fix typo and rebase main
* fix: some cr comments
* fix: file_time_bucket_span
* fix: avoid upper bound overflow
* chore: update proto
2024-05-22 09:42:21 +00:00
zyy17
b86d79b906
fix: can't print log because the tracing guard is dropped ( #4005 )
...
* fix: avoid logging guard drop
* chore: remove unused '#[allow(dead_code)]'
2024-05-22 03:24:40 +00:00
maco
40c585890a
refactor: replace Expr with datafusion::Expr ( #3995 )
...
* refactor: replace Expr with datafusion::Expr
* fix: fmt-toml
* fix: cr comment
2024-05-21 06:40:29 +00:00
Yingwen
179c8c716c
feat: Adds RegionScanner trait ( #3948 )
...
* feat: define region scanner
* feat: single partition scanner
* feat: use single partition scanner
* feat: implement ExecutionPlan wip
* feat: mito engine returns single partition scanner
* feat: implement DisplayAs for region server
* feat: dummy table provider use handle_partitioned_query()
* test: update sqlness test
* feat: table provider use ReadFromRegion
* refactor: remove StreamScanAdapter
* chore: update lock
* style: fix clippy
* refactor: remove handle_query from the RegionEngine trait
* chore: address CR comments
* refactor: rename methods
* refactor: rename ReadFromRegion to RegionScanExec
2024-05-20 11:52:00 +00:00
shuiyisong
19543f9819
feat: support compression on gRPC server ( #3961 )
...
* feat: enable gzip in grpc server side
* feat: add enable_gzip_compression config
* test: add grpc compression test
* feat: support user configured compression on grpc server
* chore: update doc
* chore: add tests
* fix: make config-docs
* chore: fix cr issue
* chore: add test
* refactor: remove config on server side, auto enable all compression support
* chore: minor update
* chore: remove unused code
* refactor: enable zstd compression internally by default
* chore: minor fix
2024-05-20 11:28:00 +00:00
Weny Xu
258675b75e
chore: bump to v0.8.0 ( #3971 )
2024-05-17 15:05:20 +00:00
discord9
3477fde0e5
feat(flow): tumble window func ( #3968 )
...
* feat(WIP): tumble window rewrite parser
* tests: tumble func
* feat: add `update_at` column for all flow output
* chore: cleanup per review
* fix: update_at not as time index
* fix: demo tumble
* fix: tests&tumble signature&accept both ts&datetime
* refactor: update_at now ts millis type
* chore: per review advices
2024-05-17 12:10:28 +00:00
WU Jingdi
e2a1cb5840
feat: support evaluate expr in range query param ( #3823 )
...
* feat: support evaluate expr in range query param
* chore: fix comment
* chore: fix code comment
* fix: disbale now in duration param
2024-05-17 08:31:55 +00:00
Ruihang Xia
4b030456f6
feat: remove timeout in the channel between frontend and datanode ( #3962 )
...
* style: change builder pattern
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* feat: remove timeout
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* remove unused config
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update docs
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2024-05-16 14:12:42 +00:00
discord9
0d9e71b653
feat(flow): flow node manager ( #3954 )
...
* feat(flow): flow node manager
feat(flow): render src/sink
feat(flow): flow node manager in standalone
fix?: higher run freq
chore: remove abunant error enum variant
fix: run with higher freq if insert more
chore: fix after rebase
chore: typos
* chore(WIP): per review
* chore: per review
2024-05-16 11:37:14 +00:00
zyy17
63a8d293a1
refactor: add Configurable trait ( #3917 )
...
* refactor: add Configurable trait
* refactor: add merge_with_cli_options() to simplify load_options()
* docs: add comments
* fix: clippy errors
* fix: toml format
* fix: build error
* fix: clippy errors
* build: downgrade config-rs
* refactor: use '#[snafu(source(from()))'
* refactor: minor modification for load_layered_options() to make it clean
2024-05-15 12:56:40 +00:00
Yohan Wal
cfae276d37
feat(fuzz): add validator for inserted rows ( #3932 )
...
* feat(fuzz): add validator for inserted rows
* fix: compatibility with mysql types
* feat(fuzz): add datetime and date type in mysql for row validator
2024-05-15 07:05:51 +00:00
Weny Xu
09129a911e
chore: update greptime-proto to a11db14 ( #3942 )
2024-05-15 03:38:47 +00:00
discord9
15d7b9755e
feat(flow): flow worker ( #3934 )
...
* feat: flow worker
* chore: fix after cherry pick
* refactor: error handling
* refactor: error handling
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: merge origin/main
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
---------
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
Co-authored-by: Zhenchi <zhongzc_arch@outlook.com >
2024-05-14 16:09:25 +00:00
discord9
4ca7ac7632
feat(flow): add types for every plan enum variant ( #3938 )
...
* feat: Plan with types
* chore: per review advices
2024-05-14 10:51:37 +00:00
dennis zhuang
efd3f04b7c
feat: create view ( #3807 )
...
* add statement
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* feat: rebase with main
* fix: create flow
* feat: adds gRPC stuff
* feat: impl create_view ddl in operator
* feat: impl CreateViewProcedure
* chore: update cargo lock
* fix: format
* chore: compile error after rebasing main
* chore: refactor and test create view parser
* chore: fixed todo list and comments
* fix: compile error after rebeasing
* test: add create view test
* test: test view_info keys
* test: adds test for CreateViewProcedure and clean code
* test: adds more sqlness test for creating views
* chore: update cargo lock
* fix: don't replace normal table in CreateViewProcedure
* chore: apply suggestion
Co-authored-by: Jeremyhi <jiachun_feng@proton.me >
* chore: style
Co-authored-by: Jeremyhi <jiachun_feng@proton.me >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: Jeremyhi <jiachun_feng@proton.me >
2024-05-14 08:03:29 +00:00
Weny Xu
e15294db41
feat: introduce TableRouteCache to PartitionRuleManager ( #3922 )
...
* chore: add `CompositeTableRouteCacheRef` to `PartitionRuleManager`
* chore: update comments
* fix: add metrics for `get`
* chore: apply suggestions from CR
* chore: correct cache name
* feat: implement `LayeredCacheRegistry`
* fix: invalidate logical tables by physical table id
* refactor: replace `CacheRegistry` with `LayeredCacheRegistry`
* chore: update comments
* chore: apply suggestions from CR
* chore: fix fmt
* refactor: use `TableRouteCache` instead
* chore: apply suggestions from CR
* chore: fix clippy
2024-05-13 13:26:43 +00:00
discord9
be1eb4efb7
feat(flow): render source/sink ( #3903 )
...
* feat(flow): render src/sink
* chore: add empty impl
* chore: typos
* refactor: according to review(WIP)
* refactor: reexport df_sbustrait&use to_sub_plan
* fix: add implict location to error enum
* fix: error handling unwrap query_ctx
2024-05-13 11:58:02 +00:00
maco
a0be7198f9
feat: migrate orc-rs to datafusion-orc ( #3923 )
2024-05-13 05:15:06 +00:00
Weny Xu
89da42dbc1
refactor: refactor frontend cache ( #3912 )
...
* feat: implement the `TableCache`
* refactor: use `TableCache`
* refactor: replace `TableFlowManager` with `TableFlownodeSetCache`
* refactor: introduce cache crate
* chore: add comments
* chore: update comments
* chore: apply suggestions from CR
* chore: rename `cache_invalidator` to `local_cache_invalidator`
* chore(fuzz): set `acquire_timeout` to 30s
2024-05-11 09:58:18 +00:00
