discord9
a44fe627ce
feat: heartbeat task&peer lookup in proc ( #4179 )
...
* feat: herat beat task
* feat: use real flow peer allocator when building
* feat: add peer look up in ddl context
* fix: drop flow test
* refactor: per review(WIP)
* refactor: not check if is alive
* refactor: per review
* refactor: remove useless `reset`
* refactor: per bot advices
* refactor: alive peer
* chore: bot review
2024-06-24 15:06:33 +00:00
taobo
77904adaaf
fix: region_peers returns same region_id for multi logical tables ( #4190 )
...
* fix: `region_peers` returns same region_id for multi logical tables
* test: add sqlness test for information_schema.region_peers
* refactor: region_peers sqlness
2024-06-24 14:12:36 +00:00
Zhenchi
07cbabab7b
feat(puffin): support lz4 compression for footer ( #4194 )
...
* feat(puffin): support lz4 compression for footer
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* address comments
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
---------
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
2024-06-24 11:39:03 +00:00
zyy17
ea7c17089f
refactor: add region_dir in CompactionRegion ( #4187 )
2024-06-24 08:25:52 +00:00
discord9
517917453d
fix(flow): fix call df func bug&sqlness test ( #4165 )
...
* tests: flow sqlness tests
* tests: WIP df func test
* fix: use schema before expand for transform expr
* tests: some basic flow tests
* tests: unit test
* chore: dep use rev not patch
* fix: wired sqlness error?
* refactor: per review
* fix: temp sqlness bug
* fix: use fixed sqlness
* fix: impl drop as async shutdown
* refactor: per bot's review
* tests: drop worker handler both sync/async
* docs: add rationale for test
* refactor: per review
* chore: fmt
2024-06-24 07:52:45 +00:00
zyy17
0139a70549
refactor: make RegionOptions and MergeOutput serializable ( #4180 )
...
* chore: make RegionOptions serializable and add region_dir in CompactionRegion
* refactor: make `PickerOutput` and `MergeOutput` serializable and deserializable
* refactor: remove Serialize and Deserialize from PickerOutput
* chore: revert changes for file.rs
* chore: revert changes for compactor.rs and compaction.rs
---------
Co-authored-by: tison <wander4096@gmail.com >
2024-06-24 07:37:53 +00:00
tison
5566dd72f2
chore: highlight our committers in CONTRIBUTING.md ( #4189 )
...
* chore: highlight our committers in CONTRIBUTING.md
Signed-off-by: tison <wander4096@gmail.com >
* chore: appy suggestion
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
* chore: apply suggestion
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
* Trigger CI
Signed-off-by: tison <wander4096@gmail.com >
---------
Signed-off-by: tison <wander4096@gmail.com >
Co-authored-by: dennis zhuang <killme2008@gmail.com >
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
2024-06-22 08:23:30 +00:00
ZonaHe
dea33a7aaf
feat: update dashboard to v0.5.2 ( #4185 )
...
Co-authored-by: ZonaHex <ZonaHex@users.noreply.github.com >
2024-06-21 14:32:46 +00:00
Weny Xu
15ad9f2f6f
fix: region logical regions after catching up ( #4176 )
...
* fix: region logical regions after catching up
* test: add metric table migration test
* chore: apply suggestions from CR
2024-06-21 10:30:18 +00:00
Ruihang Xia
fce65c97e3
feat: make RegionScanner aware of PartitionRange ( #4170 )
...
* define PartitionRange
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add optimizer rule
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* implement interfaces
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* impl aggr stream
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add fallback method
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix tests
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix tests
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix typo
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update sqlness result
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add document and rename struct
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add more comments
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix typo
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2024-06-21 09:54:22 +00:00
Ruihang Xia
ac574b66ab
feat: add num_rows and num_row_groups to manifest ( #4183 )
...
* featadd num_rows and num_row_groups to manifest
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add document
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2024-06-21 07:15:13 +00:00
Weny Xu
1e52ba325f
feat: introduce chaos crds ( #4173 )
...
feat: add chaos-mesh crds
2024-06-21 06:28:51 +00:00
Yohan Wal
b739c9fd10
feat: PREPARE and EXECUTE statement from mysql client ( #4125 )
...
* feat: prepare stmt in mysql client
* feat: execute stmt in mysql client
* fix: handle parameters properly
* refactor: use existing funcs to convert expr to scalar value
* refactor: use uuid strings as stmt_key for queries from COM_PREPARE packet
* refactor: take prepare and execute parser as submodule
* test: add unit test for converting expr to scalar value
* feat: deallocate stmt in mysql client
* chore: comments and duplicates
---------
Co-authored-by: dennis zhuang <killme2008@gmail.com >
2024-06-21 02:02:57 +00:00
Ruihang Xia
21c89f3247
perf: optimize RecordBatch to HttpOutput conversion ( #4178 )
...
* add benchmark
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* save 70ms
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add profiler
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* save 50ms
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* save 160ms
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* format toml file
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix license header
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix windows build
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2024-06-20 12:33:58 +00:00
Jeremyhi
5bcd7a14bb
feat: use the write runtime to handle the heartbeats ( #4177 )
2024-06-20 08:45:07 +00:00
dennis zhuang
4306cba866
feat: show database options ( #4174 )
...
* test: test create table with database ttl
* feat: show database options
* fix: comment
* chore: apply suggestion
Co-authored-by: Jeremyhi <jiachun_feng@proton.me >
* chore: fix CR comments and refactor
* chore: style
Co-authored-by: Weny Xu <wenymedia@gmail.com >
---------
Co-authored-by: Jeremyhi <jiachun_feng@proton.me >
Co-authored-by: Weny Xu <wenymedia@gmail.com >
2024-06-20 04:21:58 +00:00
Jeremyhi
4c3d4af127
feat: register flow node ( #4166 )
...
* feat: rename keys.rs to key.rs
* feat: refactor datanode keys
* feat: add flownode key
* feat: keep flownode's lease info in metasrv
* feat: flow selector
* feat: impl_try_from_lease_key and impl_from_str_lease_key to simple code
2024-06-20 03:46:19 +00:00
localhost
48a0f39b19
chore: enhance add pipeline http api return data ( #4167 )
...
* chore: enhance add pipeline http api return data
* chore: replaceing hard code header value
2024-06-20 02:19:31 +00:00
ZonaHe
8abebad458
feat: update dashboard to v0.5.1 ( #4171 )
...
Co-authored-by: ZonaHex <ZonaHex@users.noreply.github.com >
2024-06-20 01:46:54 +00:00
LFC
cc2f7efb98
chore: bump datafusion version to fix last_value regression ( #4169 )
...
* chore: bump datafusion version to fix `last_value` regression
* fix: resolve PR comments
* fix ci
2024-06-19 07:47:17 +00:00
taobo
22d12683b4
refactor!: unify FrontendOptions and DatanodeOptions by using GrpcOptions ( #4088 )
...
* refactor: move GrpcOptions to servers/grpc
* fix: optimize code
* fix: docs
* refactor: move DatanodeOptions.rpc_hostname to grpc.hostname
* fix: merge main
* refactor code impl
test: add test_depreacted_cli_options unit test
* Update src/servers/src/grpc.rs
Co-authored-by: Yingwen <realevenyag@gmail.com >
---------
Co-authored-by: Yingwen <realevenyag@gmail.com >
2024-06-18 22:45:38 +00:00
Yingwen
fe74efdafe
feat: Implement memtable range ( #4162 )
...
* refactor: RangeBase
* feat: memtable range
* feat: scanner use mem range
* feat: remove base from mem range context
* feat: impl ranges for memtables
* chore: fix warnings
* refactor: make predicate cheap to clone
* refactor: MemRange -> MemtableRange
* feat: pub empty memtable to fix warnings
* test: fix sqlness result
2024-06-18 22:25:19 +00:00
discord9
cd9705ccd7
feat(flow): support datafusion scalar function ( #4142 )
...
* chore: call df function types
* feat: RelationDesc to DfSchema
* refactor: use RelationDesc instead of Type
* chore: WIP get to phy expr
* feat: custom deserialize
* chore: fmt
* refactor: renaming to DfScalarFunction
* feat: eval df func(untested)
* fix: had to spawn a thread for calling async
* chore: per review advices
* tests: test df scalar function
2024-06-18 12:34:38 +00:00
Weny Xu
ea2d067cf1
feat: implement the OrderedBatchProducer ( #4134 )
...
* feat: implement the `OrderedBatchProducer`
* test: add test of cancel safety
* chore: apply suggestions from CR
* chore: apply suggestions from CR
* refactor: simplify the `BackgroundProducerWorker`
* feat: implement the OrderedBatchProducer v2
* refactor: switch to `OrderedBatchProducer`
* chore: rename to `MAX_FLUSH_QUEUE_SIZE`
* refactor: switch to `OrderedBatchProducerV2`
* refactor: remove `OrderedBatchProducerV1`
* test: add tests
* refactor: make config configurable
* refactor: minor refactor
* chore: remove unused code
* chore: remove `benchmarks` crate
* chore: update config doc
* chore: remove unused comment
* refactor: refactor client registry
* refactor: rename `max_batch_size` to `max_batch_bytes`
* chore: use constant value
* chore: ensure serialized meta < ESTIMATED_META_SIZE
* chore: apply suggestions from CR
* chore: remove the `CHANNEL_SIZE`
* chore: apply suggestions from CR
* fix: ensure serialized meta < ESTIMATED_META_SIZE
* chore: apply suggestions from CR
* chore: apply suggestions from CR
2024-06-18 07:20:01 +00:00
Ning Sun
70d113a355
feat: update default size of bgworkers, add hbworkers ( #4129 )
...
* feat: update default size of bgworkers, add hbworkers
* feat: update frontend heartbeat as well
* chore: update sample config files and default settings
* chore: update config docs
* Revert "chore: update config docs"
This reverts commit 8107f4c120f5ae701c8d
2024-06-18 06:18:37 +00:00
shuiyisong
cb657ae51e
feat(pipeline): join processor ( #4158 )
...
* feat: add join processor
* test: add join simple test
* chore: fix header
* chore: update commit
Co-authored-by: dennis zhuang <killme2008@gmail.com >
* test: add more join test
* chore: fix lint
* chore: update comment
---------
Co-authored-by: dennis zhuang <killme2008@gmail.com >
2024-06-18 05:00:34 +00:00
Jeremyhi
141d017576
feat: enable metasrv to accept flownode's heartbeats ( #4160 )
...
* feat: make metasrv can accept flownode's heartbeat
* chore: proto
2024-06-18 04:07:46 +00:00
yuanbohan
0fc18b6865
feat(pipeline): gsub prosessor ( #4121 )
...
* chore: add log http ingester scaffold
* chore: add some example code
* chore: add log inserter
* chore: add log handler file
* chore: add pipeline lib
* chore: import log handler
* chore: add pipelime http handler
* chore: add pipeline private table
* chore: add pipeline API
* chore: improve error handling
* chore: merge main
* chore: add multi content type support for log handler
* refactor: remove servers dep on pipeline
* refactor: move define_into_tonic_status to common-error
* refactor: bring in pipeline 3eb890c551b8d7f60c4491fcfec18966e2b210a4
* chore: fix typo
* refactor: bring in pipeline a95c9767d7056ab01dd8ca5fa1214456c6ffc72c
* chore: fix typo and license header
* refactor: move http event handler to a separate file
* chore: add test for pipeline
* chore: fmt
* refactor: bring in pipeline 7d2402701877901871dd1294a65ac937605a6a93
* refactor: move `pipeline_operator` to `pipeline` crate
* chore: minor update
* refactor: bring in pipeline 1711f4d46687bada72426d88cda417899e0ae3a4
* chore: add log
* chore: add log
* chore: remove open hook
* chore: minor update
* chore: fix fmt
* chore: minor update
* chore: rename desc for pipeline table
* refactor: remove updated_at in pipelines
* chore: add more content type support for log inserter api
* chore: introduce pipeline crate
* chore: update upload pipeline api
* chore: fix by pr commit
* chore: add some doc for pub fn/struct
* chore: some minro fix
* chore: add pipeline version support
* chore: impl log pipeline version
* gsub prosessor
* chore: add test
* chore: update commit
Co-authored-by: dennis zhuang <killme2008@gmail.com >
---------
Co-authored-by: paomian <xpaomian@gmail.com >
Co-authored-by: shuiyisong <xixing.sys@gmail.com >
Co-authored-by: shuiyisong <113876041+shuiyisong@users.noreply.github.com >
Co-authored-by: dennis zhuang <killme2008@gmail.com >
2024-06-17 07:57:47 +00:00
yuanbohan
0aceebf0a3
feat(pipeline): transform support on_failure ( #4123 )
...
* chore: add log http ingester scaffold
* chore: add some example code
* chore: add log inserter
* chore: add log handler file
* chore: add pipeline lib
* chore: import log handler
* chore: add pipelime http handler
* chore: add pipeline private table
* chore: add pipeline API
* chore: improve error handling
* chore: merge main
* chore: add multi content type support for log handler
* refactor: remove servers dep on pipeline
* refactor: move define_into_tonic_status to common-error
* refactor: bring in pipeline 3eb890c551b8d7f60c4491fcfec18966e2b210a4
* chore: fix typo
* refactor: bring in pipeline a95c9767d7056ab01dd8ca5fa1214456c6ffc72c
* chore: fix typo and license header
* refactor: move http event handler to a separate file
* chore: add test for pipeline
* chore: fmt
* refactor: bring in pipeline 7d2402701877901871dd1294a65ac937605a6a93
* refactor: move `pipeline_operator` to `pipeline` crate
* chore: minor update
* refactor: bring in pipeline 1711f4d46687bada72426d88cda417899e0ae3a4
* chore: add log
* chore: add log
* chore: remove open hook
* chore: minor update
* chore: fix fmt
* chore: minor update
* chore: rename desc for pipeline table
* refactor: remove updated_at in pipelines
* chore: add more content type support for log inserter api
* chore: introduce pipeline crate
* chore: update upload pipeline api
* chore: fix by pr commit
* chore: add some doc for pub fn/struct
* chore: some minro fix
* chore: add pipeline version support
* chore: impl log pipeline version
* transform on_failure
* chore: add test
* chore: move test to a separate file
* chore: add comment
---------
Co-authored-by: paomian <xpaomian@gmail.com >
Co-authored-by: shuiyisong <xixing.sys@gmail.com >
2024-06-17 06:56:31 +00:00
Yingwen
558272de61
refactor: Decouple dedup and merge ( #4139 )
...
* feat: remove dedup/filter deleted from merge reader
* feat: impl dedup reader
* feat: support filter deleted flag
* test: test dedup reader
* feat: remove put_only field
* chore: fix clippy
* feat: metrics
* test: test empty batch
* perf: optimize dedup strategy
Avoid iterating all timestamps.
* test: fix test
* feat: generic
2024-06-17 04:09:50 +00:00
LFC
f4a5a44549
refactor: make region manifest checkpoint ran in background ( #4133 )
...
* refactor: use in-database manifest as checkpoint instead of merging incremental files in object store
* refactor: make region manifest checkpoint ran in background
* reduce unnecessary metrics
* Update src/mito2/src/manifest/checkpointer.rs
Co-authored-by: Yingwen <realevenyag@gmail.com >
* resolve PR comments
* resolve PR comments
---------
Co-authored-by: Yingwen <realevenyag@gmail.com >
2024-06-17 03:47:18 +00:00
zyy17
5390603855
refactor: add Compactor trait to abstract the compaction ( #4097 )
...
* refactor: add Compactor trait
* chore: add compact() in Compactor trait and expose compaction module
* refactor: add CompactionRequest and open_compaction_region
* refactor: export the compaction api
* refactor: add DefaultCompactor::new_from_request
* refactor: no need to pass mito_config in open_compaction_region()
* refactor: CompactionRequest -> &CompactionRequest
* fix: typo
* docs: add docs for public apis
* refactor: remove 'Picker' from Compactor
* chore: add logs
* chore: change pub attribute for Picker
* refactor: remove do_merge_ssts()
* refactor: update comments
* refactor: use CompactionRegion argument in Picker
* chore: make compaction module public and remove unnessary clone
* refactor: move build_compaction_task() in CompactionScheduler{}
* chore: use in open_compaction_region() and add some comments for public structure
* refactor: add 'manifest_dir()' in store-api
* refactor: move the default implementation to DefaultCompactor
* refactor: remove Options from MergeOutput
* chore: minor modification
* fix: clippy errors
* fix: unit test errors
* refactor: remove 'manifest_dir()' from store-api crate(already have one in opener)
* refactor: use 'region_dir' in CompactionRequest
* refactor: refine naming
* refactor: refine naming
* refactor: remove clone()
* chore: add comments
* refactor: add PickerOutput field in CompactorRequest
2024-06-17 03:03:47 +00:00
Ruihang Xia
a2e3532a57
docs: add guide for tsbs benchmark ( #4151 )
...
* docs: add guide for tsbs benchmark
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix typo
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2024-06-16 16:02:15 +08:00
Ruihang Xia
2faa6d6c97
ci: align docs with develop ( #4152 )
...
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2024-06-15 16:33:57 +00:00
Weny Xu
d6392acd65
fix(sqlness): catch different format timestamp ( #4149 )
2024-06-15 11:13:01 +00:00
localhost
01e3a24cf7
feat: log ingestion support ( #4014 )
...
* chore: add log http ingester scaffold
* chore: add some example code
* chore: add log inserter
* chore: add log handler file
* chore: add pipeline lib
* chore: import log handler
* chore: add pipelime http handler
* chore: add pipeline private table
* chore: add pipeline API
* chore: improve error handling
* chore: merge main
* chore: add multi content type support for log handler
* refactor: remove servers dep on pipeline
* refactor: move define_into_tonic_status to common-error
* refactor: bring in pipeline 3eb890c551b8d7f60c4491fcfec18966e2b210a4
* chore: fix typo
* refactor: bring in pipeline a95c9767d7056ab01dd8ca5fa1214456c6ffc72c
* chore: fix typo and license header
* refactor: move http event handler to a separate file
* chore: add test for pipeline
* chore: fmt
* refactor: bring in pipeline 7d2402701877901871dd1294a65ac937605a6a93
* refactor: move `pipeline_operator` to `pipeline` crate
* chore: minor update
* refactor: bring in pipeline 1711f4d46687bada72426d88cda417899e0ae3a4
* chore: add log
* chore: add log
* chore: remove open hook
* chore: minor update
* chore: fix fmt
* chore: minor update
* chore: rename desc for pipeline table
* refactor: remove updated_at in pipelines
* chore: add more content type support for log inserter api
* chore: introduce pipeline crate
* chore: update upload pipeline api
* chore: fix by pr commit
* chore: add some doc for pub fn/struct
* chore: some minro fix
* chore: add pipeline version support
* chore: impl log pipeline version
* chore: fix format issue
* fix: make the LogicalPlan of a query pipeline sorted in desc order
* chore: remove some debug log
* chore: replacing hashmap cache with moak
* chore: fix by pr commit
* chore: fix toml format issue
* chore: update Cargo.lock
* chore: fix by pr commit
* chore: fix some issue by pr commit
* chore: add more doc for pipeline version
---------
Co-authored-by: shuiyisong <xixing.sys@gmail.com >
2024-06-14 17:03:30 +00:00
Weny Xu
bf3ad44584
fix: fix release CI typo ( #4147 )
...
* fix: ci typo
* chore: use aws registry
2024-06-14 14:29:34 +00:00
Weny Xu
11a903f193
chore(ci): switch to aws registry ( #4145 )
...
chore: switch to aws registry
2024-06-14 11:46:57 +00:00
Weny Xu
acdfaabfa5
fix(ci): use ld_classic on macOS ( #4143 )
...
fix: use ld_classic on macos
2024-06-14 08:09:12 +00:00
Weny Xu
54ca06ba08
chore: bump version to v0.8.2 ( #4141 )
2024-06-14 03:39:08 +00:00
Weny Xu
1f315e300f
fix: retry on unknown error ( #4138 )
2024-06-13 11:15:38 +00:00
Weny Xu
573e25a40f
chore: run fuzz tests with disk cache ( #4118 )
...
* chore: run fuzz tests with disk cache
* fix: print error messages correctly
2024-06-13 09:07:12 +00:00
Lei, HUANG
f8ec46493f
refactor: simplify parquet writer ( #4112 )
...
* refactor: simplify parquet writer
* chore: fix clippy
* refactor: use AsyncArrowWriter instead of BufferedWriter
* refactor: remove BufferedWriter
* fix: add chunk parameter to avoid entity too small issue
* refactor: use AtomicUsize instead of Mutex
* fix: add chunk argument to stream_to_parquet
* chore: fmt
* wip: fail check
* fix: check
* fmt
* refactor: use impl Future instead of async_trait
* fmt
* refactor: use associate types
2024-06-13 07:32:47 +00:00
Weny Xu
14a2d83594
chore: remove unused code ( #4135 )
...
* chore: remove unused code
* Update src/mito2/src/wal/entry_reader.rs
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
---------
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
2024-06-12 13:18:33 +00:00
Yingwen
65f8b72d34
feat: Implement RegionScanner for SeqScan ( #4060 )
...
* feat: ordered builder wip
* feat: impl RegionScanner for SeqScan
* feat: implement scan_partition and build_stream
* chore: return SeqScan as RegionScanner
* fix: group parts
* feat: split parts
* chore: reader metrics
* chore: metrics
* chore: remove unused codes
* chore: support holding a group of ranges in ScanPart
* feat: group ScanParts to ScanParts
* feat: impl SeqScanner again
* chore: observe build cost in ScannerMetrics
* chore: fix compiler warnings
* style: fix clippy
* docs: update config docs
* chore: forward DisplayAs to scanner
* test: update sqlness tests
* chore: update debug fmt
* chore: custom debug for timestamp
fix test compiling issue with common-macro when running
cargo nextest -p common-time
* chore: update debug format
* feat: update fmt for scan part
* chore: fix warning
* fix: sanitize parallelism
* feat: split parts
* test: fix config api test
* feat: update logs
* chore: Revert "chore: remove unused codes"
This reverts commit b548b30a01eeded59b1a0a8d89f9293ca63afc41.
* chore: Revert "docs: update config docs"
This reverts commit a7997e78d6ddcf635560574de8c1948c495bdd12.
* feat: each partition scan files in parallel
* test: fix config api test
* docs: fix typo
* chore: address comments, simplify tests
* feat: global semaphore
* feat: always spawn task
* chore: simplify default explain output format
* handle output partiton number is 0
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix typo
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
2024-06-12 08:21:30 +00:00
LFC
9473daab8b
fix: explicitly set config instead of using changable default in tests ( #4132 )
...
* fix: explicitly set config instead of using changable default in tests
* fix: resolve PR comments
2024-06-11 10:51:01 +00:00
LFC
5a6021e34f
refactor: remove substrait ser/de for region query in standalone ( #3812 )
...
* refactor: remove substrait serde for region query in standalone
* fix ci
* move QueryRequest to common-query
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* format code
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* format toml file
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* chore: format toml
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: Yingwen <realevenyag@gmail.com >
2024-06-11 09:33:47 +00:00
discord9
1b00526de5
fix(flow): infer table schema correctly ( #4113 )
...
* refactor: make individual col name optional
* chore: rename TypedPlan's `typ` to `schema`
* feat: add optional col name to typed plan
* feat: pass col name all along
* feat: correct infer output table schema
* chore: unused import
* fix: error when key is not projected
* refactor: per review
* chore: fmt
2024-06-11 08:57:47 +00:00
Yingwen
5533bd9293
chore(common-macro): remove features covered by full ( #4131 )
2024-06-11 07:44:53 +00:00
Ning Sun
587e99d806
fix: macro crate cannot be compiled alone ( #4130 )
...
* fix: macro crate cannot be compiled alone
* Update src/common/macro/Cargo.toml
Co-authored-by: Yingwen <realevenyag@gmail.com >
---------
Co-authored-by: tison <wander4096@gmail.com >
Co-authored-by: Yingwen <realevenyag@gmail.com >
2024-06-11 05:36:29 +00:00
