Jeremyhi
df0fff2f2c
feat(servers): make http timeout and body limit optional ( #4217 )
...
* feat(servers): make http timeout and body limit optional
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add comment
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* chore: make config-docs
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
2024-06-26 06:14:14 +00:00
dennis zhuang
a779cb36ec
fix: wrong frontend registration address ( #4199 )
...
* fix: frontend registration address is wrong, #4186
* fix: license header
* chore: adds hostname to frontend grpc
* fix: forgot run make config-docs
* chore: warn when using bind_addr
* fix: flow node heartbeat carrying address
2024-06-26 06:13:07 +00:00
zyy17
948c8695d0
refactor: add SerializedPickerOutput and field modification of CompactorRequest ( #4198 )
...
* refactor: remove compaction_options and use RegionOptions type for region_options
* refactor: add file_purger field in CompactionRegion
* refactor: add SerializedPickerOutput
* refactor: rename CompactorRequest to OpenCompactionRegionRequest and remove PickerOutput
* refactor: use &PickerOutput instead of clone()
2024-06-25 13:04:07 +00:00
Ruihang Xia
4d4a6cd265
feat: validate partition rule on create table ( #4213 )
...
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2024-06-25 12:55:01 +00:00
Zhenchi
5dde148b3d
feat(puffin): implement CachedPuffinReader ( #4209 )
...
* feat(puffin): implement CachedPuffinReader
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: next PR to introduce CachedPuffinManager
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: rename
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* address comments
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
---------
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
2024-06-25 12:27:06 +00:00
Weny Xu
8cbe7166b0
refactor: migrate region failover implementation to region migration ( #4172 )
...
* refactor: migrate region failover implementation to region migration
* fix: use HEARTBEAT_INTERVAL_MILLIS as lease secs
* fix: return false if leader is downgraded
* fix: only remove failure detector after submitting procedure successfully
* feat: ignore dropped region
* refactor: retrieve table routes in batches
* refactor: disable region failover on local WAL implementation
* fix: move the guard into procedure
* feat: use real peer addr
* feat: use interval instead of sleep
* chore: rename `HeartbeatSender` to `HeartbeatAcceptor`
* chore: apply suggestions from CR
* chore: reduce duplicate code
* chore: apply suggestions from CR
* feat: lookup peer addr
* chore: add comments
* chore: apply suggestions from CR
* chore: apply suggestions from CR
2024-06-25 11:58:17 +00:00
Yingwen
f5ac158605
docs: remove outdated docs ( #4205 )
...
* docs: remove outdated docs
* ci: align ci
* chore: Revert "ci: align ci"
This reverts commit 2c3c0eed7e
2024-06-25 09:46:30 +00:00
Lei, HUANG
120447779c
feat: bulk memtable codec ( #4163 )
...
* feat: introduce bulk memtable encoder/decoder
* chore: rebase main
* chore: resolve some comments
* refactor: only carries time unit in ArraysSorter
* fix: some comments
2024-06-25 09:02:20 +00:00
discord9
82f6373574
feat: FlownodeClient ( #4206 )
...
* feat: FlownodeClient
* chore: remove wrong doc
* fix: debug impl for NodeClients
* chore: rename `FlownodeClient` to `FlowRequester`
2024-06-25 08:40:24 +00:00
Zhenchi
1e815dddf1
feat(puffin): implement CachedPuffinWriter ( #4203 )
...
* feat(puffin): support lz4 compression for footer
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* feat(puffin): introduce puffin manager trait
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: polish
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* feat(puffin): implement CachedPuffinWriter
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: polish
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
---------
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
2024-06-25 08:00:48 +00:00
Weny Xu
b2f61aa1cf
fix: format error correctly ( #4204 )
...
* chore: remove TODO comments
* fix: format error correctly
2024-06-25 07:56:13 +00:00
Ruihang Xia
a1e2612bbf
fix: align workflows again for the troublesome GHA ( #4196 )
...
* fix: align workflows again for the troublesome GHA
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* unify
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2024-06-25 06:52:01 +00:00
Yingwen
9aaf7d79bf
feat: Dedup strategy that keeps the last not null field ( #4184 )
...
* feat: dedup strategy: last not null
* fix: fix tests
* fix: fix single batch
* chore: warning
* chore: skip has_null check
* refactor: rename fields
* fix: merge last fields may not reset builder
* chore: clear before filter deleted
* chore: remove debug logs
* chore: Update comment
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
---------
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
2024-06-25 06:38:48 +00:00
Yingwen
4a4237115a
test: wait until checkpoint finish ( #4202 )
2024-06-25 06:21:19 +00:00
Eugene Tolbakov
840f81e0fd
fix(sql): improve compound signed number processing ( #4200 )
2024-06-25 04:01:46 +00:00
Eugene Tolbakov
cdd4baf183
feat(sql): improve interval expression, support shortened version ( #4182 )
...
* feat(sql): improve interval expression, support shortened version
* fix(sql): remove accidental change of sqlness assertion
* fix(sql): address CR feedback, add more tests
* chore(sql): add more tests
2024-06-24 20:29:34 +00:00
Zhenchi
4b42c7b840
feat(puffin): introduce puffin manager trait ( #4195 )
...
* feat(puffin): support lz4 compression for footer
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* feat(puffin): introduce puffin manager trait
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: polish
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
---------
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
2024-06-24 16:02:52 +00:00
discord9
a44fe627ce
feat: heartbeat task&peer lookup in proc ( #4179 )
...
* feat: herat beat task
* feat: use real flow peer allocator when building
* feat: add peer look up in ddl context
* fix: drop flow test
* refactor: per review(WIP)
* refactor: not check if is alive
* refactor: per review
* refactor: remove useless `reset`
* refactor: per bot advices
* refactor: alive peer
* chore: bot review
2024-06-24 15:06:33 +00:00
taobo
77904adaaf
fix: region_peers returns same region_id for multi logical tables ( #4190 )
...
* fix: `region_peers` returns same region_id for multi logical tables
* test: add sqlness test for information_schema.region_peers
* refactor: region_peers sqlness
2024-06-24 14:12:36 +00:00
Zhenchi
07cbabab7b
feat(puffin): support lz4 compression for footer ( #4194 )
...
* feat(puffin): support lz4 compression for footer
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* address comments
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
---------
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
2024-06-24 11:39:03 +00:00
zyy17
ea7c17089f
refactor: add region_dir in CompactionRegion ( #4187 )
2024-06-24 08:25:52 +00:00
discord9
517917453d
fix(flow): fix call df func bug&sqlness test ( #4165 )
...
* tests: flow sqlness tests
* tests: WIP df func test
* fix: use schema before expand for transform expr
* tests: some basic flow tests
* tests: unit test
* chore: dep use rev not patch
* fix: wired sqlness error?
* refactor: per review
* fix: temp sqlness bug
* fix: use fixed sqlness
* fix: impl drop as async shutdown
* refactor: per bot's review
* tests: drop worker handler both sync/async
* docs: add rationale for test
* refactor: per review
* chore: fmt
2024-06-24 07:52:45 +00:00
zyy17
0139a70549
refactor: make RegionOptions and MergeOutput serializable ( #4180 )
...
* chore: make RegionOptions serializable and add region_dir in CompactionRegion
* refactor: make `PickerOutput` and `MergeOutput` serializable and deserializable
* refactor: remove Serialize and Deserialize from PickerOutput
* chore: revert changes for file.rs
* chore: revert changes for compactor.rs and compaction.rs
---------
Co-authored-by: tison <wander4096@gmail.com >
2024-06-24 07:37:53 +00:00
tison
5566dd72f2
chore: highlight our committers in CONTRIBUTING.md ( #4189 )
...
* chore: highlight our committers in CONTRIBUTING.md
Signed-off-by: tison <wander4096@gmail.com >
* chore: appy suggestion
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
* chore: apply suggestion
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
* Trigger CI
Signed-off-by: tison <wander4096@gmail.com >
---------
Signed-off-by: tison <wander4096@gmail.com >
Co-authored-by: dennis zhuang <killme2008@gmail.com >
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
2024-06-22 08:23:30 +00:00
ZonaHe
dea33a7aaf
feat: update dashboard to v0.5.2 ( #4185 )
...
Co-authored-by: ZonaHex <ZonaHex@users.noreply.github.com >
2024-06-21 14:32:46 +00:00
Weny Xu
15ad9f2f6f
fix: region logical regions after catching up ( #4176 )
...
* fix: region logical regions after catching up
* test: add metric table migration test
* chore: apply suggestions from CR
2024-06-21 10:30:18 +00:00
Ruihang Xia
fce65c97e3
feat: make RegionScanner aware of PartitionRange ( #4170 )
...
* define PartitionRange
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add optimizer rule
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* implement interfaces
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* impl aggr stream
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add fallback method
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix tests
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix tests
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix typo
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update sqlness result
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add document and rename struct
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add more comments
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix typo
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2024-06-21 09:54:22 +00:00
Ruihang Xia
ac574b66ab
feat: add num_rows and num_row_groups to manifest ( #4183 )
...
* featadd num_rows and num_row_groups to manifest
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add document
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2024-06-21 07:15:13 +00:00
Weny Xu
1e52ba325f
feat: introduce chaos crds ( #4173 )
...
feat: add chaos-mesh crds
2024-06-21 06:28:51 +00:00
Yohan Wal
b739c9fd10
feat: PREPARE and EXECUTE statement from mysql client ( #4125 )
...
* feat: prepare stmt in mysql client
* feat: execute stmt in mysql client
* fix: handle parameters properly
* refactor: use existing funcs to convert expr to scalar value
* refactor: use uuid strings as stmt_key for queries from COM_PREPARE packet
* refactor: take prepare and execute parser as submodule
* test: add unit test for converting expr to scalar value
* feat: deallocate stmt in mysql client
* chore: comments and duplicates
---------
Co-authored-by: dennis zhuang <killme2008@gmail.com >
2024-06-21 02:02:57 +00:00
Ruihang Xia
21c89f3247
perf: optimize RecordBatch to HttpOutput conversion ( #4178 )
...
* add benchmark
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* save 70ms
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add profiler
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* save 50ms
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* save 160ms
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* format toml file
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix license header
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix windows build
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2024-06-20 12:33:58 +00:00
Jeremyhi
5bcd7a14bb
feat: use the write runtime to handle the heartbeats ( #4177 )
2024-06-20 08:45:07 +00:00
dennis zhuang
4306cba866
feat: show database options ( #4174 )
...
* test: test create table with database ttl
* feat: show database options
* fix: comment
* chore: apply suggestion
Co-authored-by: Jeremyhi <jiachun_feng@proton.me >
* chore: fix CR comments and refactor
* chore: style
Co-authored-by: Weny Xu <wenymedia@gmail.com >
---------
Co-authored-by: Jeremyhi <jiachun_feng@proton.me >
Co-authored-by: Weny Xu <wenymedia@gmail.com >
2024-06-20 04:21:58 +00:00
Jeremyhi
4c3d4af127
feat: register flow node ( #4166 )
...
* feat: rename keys.rs to key.rs
* feat: refactor datanode keys
* feat: add flownode key
* feat: keep flownode's lease info in metasrv
* feat: flow selector
* feat: impl_try_from_lease_key and impl_from_str_lease_key to simple code
2024-06-20 03:46:19 +00:00
localhost
48a0f39b19
chore: enhance add pipeline http api return data ( #4167 )
...
* chore: enhance add pipeline http api return data
* chore: replaceing hard code header value
2024-06-20 02:19:31 +00:00
ZonaHe
8abebad458
feat: update dashboard to v0.5.1 ( #4171 )
...
Co-authored-by: ZonaHex <ZonaHex@users.noreply.github.com >
2024-06-20 01:46:54 +00:00
LFC
cc2f7efb98
chore: bump datafusion version to fix last_value regression ( #4169 )
...
* chore: bump datafusion version to fix `last_value` regression
* fix: resolve PR comments
* fix ci
2024-06-19 07:47:17 +00:00
taobo
22d12683b4
refactor!: unify FrontendOptions and DatanodeOptions by using GrpcOptions ( #4088 )
...
* refactor: move GrpcOptions to servers/grpc
* fix: optimize code
* fix: docs
* refactor: move DatanodeOptions.rpc_hostname to grpc.hostname
* fix: merge main
* refactor code impl
test: add test_depreacted_cli_options unit test
* Update src/servers/src/grpc.rs
Co-authored-by: Yingwen <realevenyag@gmail.com >
---------
Co-authored-by: Yingwen <realevenyag@gmail.com >
2024-06-18 22:45:38 +00:00
Yingwen
fe74efdafe
feat: Implement memtable range ( #4162 )
...
* refactor: RangeBase
* feat: memtable range
* feat: scanner use mem range
* feat: remove base from mem range context
* feat: impl ranges for memtables
* chore: fix warnings
* refactor: make predicate cheap to clone
* refactor: MemRange -> MemtableRange
* feat: pub empty memtable to fix warnings
* test: fix sqlness result
2024-06-18 22:25:19 +00:00
discord9
cd9705ccd7
feat(flow): support datafusion scalar function ( #4142 )
...
* chore: call df function types
* feat: RelationDesc to DfSchema
* refactor: use RelationDesc instead of Type
* chore: WIP get to phy expr
* feat: custom deserialize
* chore: fmt
* refactor: renaming to DfScalarFunction
* feat: eval df func(untested)
* fix: had to spawn a thread for calling async
* chore: per review advices
* tests: test df scalar function
2024-06-18 12:34:38 +00:00
Weny Xu
ea2d067cf1
feat: implement the OrderedBatchProducer ( #4134 )
...
* feat: implement the `OrderedBatchProducer`
* test: add test of cancel safety
* chore: apply suggestions from CR
* chore: apply suggestions from CR
* refactor: simplify the `BackgroundProducerWorker`
* feat: implement the OrderedBatchProducer v2
* refactor: switch to `OrderedBatchProducer`
* chore: rename to `MAX_FLUSH_QUEUE_SIZE`
* refactor: switch to `OrderedBatchProducerV2`
* refactor: remove `OrderedBatchProducerV1`
* test: add tests
* refactor: make config configurable
* refactor: minor refactor
* chore: remove unused code
* chore: remove `benchmarks` crate
* chore: update config doc
* chore: remove unused comment
* refactor: refactor client registry
* refactor: rename `max_batch_size` to `max_batch_bytes`
* chore: use constant value
* chore: ensure serialized meta < ESTIMATED_META_SIZE
* chore: apply suggestions from CR
* chore: remove the `CHANNEL_SIZE`
* chore: apply suggestions from CR
* fix: ensure serialized meta < ESTIMATED_META_SIZE
* chore: apply suggestions from CR
* chore: apply suggestions from CR
2024-06-18 07:20:01 +00:00
Ning Sun
70d113a355
feat: update default size of bgworkers, add hbworkers ( #4129 )
...
* feat: update default size of bgworkers, add hbworkers
* feat: update frontend heartbeat as well
* chore: update sample config files and default settings
* chore: update config docs
* Revert "chore: update config docs"
This reverts commit 8107f4c120f5ae701c8d
2024-06-18 06:18:37 +00:00
shuiyisong
cb657ae51e
feat(pipeline): join processor ( #4158 )
...
* feat: add join processor
* test: add join simple test
* chore: fix header
* chore: update commit
Co-authored-by: dennis zhuang <killme2008@gmail.com >
* test: add more join test
* chore: fix lint
* chore: update comment
---------
Co-authored-by: dennis zhuang <killme2008@gmail.com >
2024-06-18 05:00:34 +00:00
Jeremyhi
141d017576
feat: enable metasrv to accept flownode's heartbeats ( #4160 )
...
* feat: make metasrv can accept flownode's heartbeat
* chore: proto
2024-06-18 04:07:46 +00:00
yuanbohan
0fc18b6865
feat(pipeline): gsub prosessor ( #4121 )
...
* chore: add log http ingester scaffold
* chore: add some example code
* chore: add log inserter
* chore: add log handler file
* chore: add pipeline lib
* chore: import log handler
* chore: add pipelime http handler
* chore: add pipeline private table
* chore: add pipeline API
* chore: improve error handling
* chore: merge main
* chore: add multi content type support for log handler
* refactor: remove servers dep on pipeline
* refactor: move define_into_tonic_status to common-error
* refactor: bring in pipeline 3eb890c551b8d7f60c4491fcfec18966e2b210a4
* chore: fix typo
* refactor: bring in pipeline a95c9767d7056ab01dd8ca5fa1214456c6ffc72c
* chore: fix typo and license header
* refactor: move http event handler to a separate file
* chore: add test for pipeline
* chore: fmt
* refactor: bring in pipeline 7d2402701877901871dd1294a65ac937605a6a93
* refactor: move `pipeline_operator` to `pipeline` crate
* chore: minor update
* refactor: bring in pipeline 1711f4d46687bada72426d88cda417899e0ae3a4
* chore: add log
* chore: add log
* chore: remove open hook
* chore: minor update
* chore: fix fmt
* chore: minor update
* chore: rename desc for pipeline table
* refactor: remove updated_at in pipelines
* chore: add more content type support for log inserter api
* chore: introduce pipeline crate
* chore: update upload pipeline api
* chore: fix by pr commit
* chore: add some doc for pub fn/struct
* chore: some minro fix
* chore: add pipeline version support
* chore: impl log pipeline version
* gsub prosessor
* chore: add test
* chore: update commit
Co-authored-by: dennis zhuang <killme2008@gmail.com >
---------
Co-authored-by: paomian <xpaomian@gmail.com >
Co-authored-by: shuiyisong <xixing.sys@gmail.com >
Co-authored-by: shuiyisong <113876041+shuiyisong@users.noreply.github.com >
Co-authored-by: dennis zhuang <killme2008@gmail.com >
2024-06-17 07:57:47 +00:00
yuanbohan
0aceebf0a3
feat(pipeline): transform support on_failure ( #4123 )
...
* chore: add log http ingester scaffold
* chore: add some example code
* chore: add log inserter
* chore: add log handler file
* chore: add pipeline lib
* chore: import log handler
* chore: add pipelime http handler
* chore: add pipeline private table
* chore: add pipeline API
* chore: improve error handling
* chore: merge main
* chore: add multi content type support for log handler
* refactor: remove servers dep on pipeline
* refactor: move define_into_tonic_status to common-error
* refactor: bring in pipeline 3eb890c551b8d7f60c4491fcfec18966e2b210a4
* chore: fix typo
* refactor: bring in pipeline a95c9767d7056ab01dd8ca5fa1214456c6ffc72c
* chore: fix typo and license header
* refactor: move http event handler to a separate file
* chore: add test for pipeline
* chore: fmt
* refactor: bring in pipeline 7d2402701877901871dd1294a65ac937605a6a93
* refactor: move `pipeline_operator` to `pipeline` crate
* chore: minor update
* refactor: bring in pipeline 1711f4d46687bada72426d88cda417899e0ae3a4
* chore: add log
* chore: add log
* chore: remove open hook
* chore: minor update
* chore: fix fmt
* chore: minor update
* chore: rename desc for pipeline table
* refactor: remove updated_at in pipelines
* chore: add more content type support for log inserter api
* chore: introduce pipeline crate
* chore: update upload pipeline api
* chore: fix by pr commit
* chore: add some doc for pub fn/struct
* chore: some minro fix
* chore: add pipeline version support
* chore: impl log pipeline version
* transform on_failure
* chore: add test
* chore: move test to a separate file
* chore: add comment
---------
Co-authored-by: paomian <xpaomian@gmail.com >
Co-authored-by: shuiyisong <xixing.sys@gmail.com >
2024-06-17 06:56:31 +00:00
Yingwen
558272de61
refactor: Decouple dedup and merge ( #4139 )
...
* feat: remove dedup/filter deleted from merge reader
* feat: impl dedup reader
* feat: support filter deleted flag
* test: test dedup reader
* feat: remove put_only field
* chore: fix clippy
* feat: metrics
* test: test empty batch
* perf: optimize dedup strategy
Avoid iterating all timestamps.
* test: fix test
* feat: generic
2024-06-17 04:09:50 +00:00
LFC
f4a5a44549
refactor: make region manifest checkpoint ran in background ( #4133 )
...
* refactor: use in-database manifest as checkpoint instead of merging incremental files in object store
* refactor: make region manifest checkpoint ran in background
* reduce unnecessary metrics
* Update src/mito2/src/manifest/checkpointer.rs
Co-authored-by: Yingwen <realevenyag@gmail.com >
* resolve PR comments
* resolve PR comments
---------
Co-authored-by: Yingwen <realevenyag@gmail.com >
2024-06-17 03:47:18 +00:00
zyy17
5390603855
refactor: add Compactor trait to abstract the compaction ( #4097 )
...
* refactor: add Compactor trait
* chore: add compact() in Compactor trait and expose compaction module
* refactor: add CompactionRequest and open_compaction_region
* refactor: export the compaction api
* refactor: add DefaultCompactor::new_from_request
* refactor: no need to pass mito_config in open_compaction_region()
* refactor: CompactionRequest -> &CompactionRequest
* fix: typo
* docs: add docs for public apis
* refactor: remove 'Picker' from Compactor
* chore: add logs
* chore: change pub attribute for Picker
* refactor: remove do_merge_ssts()
* refactor: update comments
* refactor: use CompactionRegion argument in Picker
* chore: make compaction module public and remove unnessary clone
* refactor: move build_compaction_task() in CompactionScheduler{}
* chore: use in open_compaction_region() and add some comments for public structure
* refactor: add 'manifest_dir()' in store-api
* refactor: move the default implementation to DefaultCompactor
* refactor: remove Options from MergeOutput
* chore: minor modification
* fix: clippy errors
* fix: unit test errors
* refactor: remove 'manifest_dir()' from store-api crate(already have one in opener)
* refactor: use 'region_dir' in CompactionRequest
* refactor: refine naming
* refactor: refine naming
* refactor: remove clone()
* chore: add comments
* refactor: add PickerOutput field in CompactorRequest
2024-06-17 03:03:47 +00:00
Ruihang Xia
a2e3532a57
docs: add guide for tsbs benchmark ( #4151 )
...
* docs: add guide for tsbs benchmark
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix typo
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2024-06-16 16:02:15 +08:00
