zyy17 5390603855 refactor: add Compactor trait to abstract the compaction (#4097) ...

* refactor: add Compactor trait

* chore: add compact() in Compactor trait and expose compaction module

* refactor: add CompactionRequest and open_compaction_region

* refactor: export the compaction api

* refactor: add DefaultCompactor::new_from_request

* refactor: no need to pass mito_config in open_compaction_region()

* refactor: CompactionRequest -> &CompactionRequest

* fix: typo

* docs: add docs for public apis

* refactor: remove 'Picker' from Compactor

* chore: add logs

* chore: change pub attribute for Picker

* refactor: remove do_merge_ssts()

* refactor: update comments

* refactor: use CompactionRegion argument in Picker

* chore: make compaction module public and remove unnessary clone

* refactor: move build_compaction_task() in CompactionScheduler{}

* chore: use  in open_compaction_region() and add some comments for public structure

* refactor: add 'manifest_dir()' in store-api

* refactor: move the default implementation to DefaultCompactor

* refactor: remove Options from MergeOutput

* chore: minor modification

* fix: clippy errors

* fix: unit test errors

* refactor: remove 'manifest_dir()' from store-api crate(already have one in opener)

* refactor: use 'region_dir' in CompactionRequest

* refactor: refine naming

* refactor: refine naming

* refactor: remove clone()

* chore: add comments

* refactor: add PickerOutput field in CompactorRequest

2024-06-17 03:03:47 +00:00

..

api

feat: create view (#3807)

2024-05-14 08:03:29 +00:00

auth

feat: log ingestion support (#4014)

2024-06-14 17:03:30 +00:00

cache

feat: querying from view works (#3952)

2024-05-30 21:45:56 +00:00

catalog

chore: run fuzz tests with disk cache (#4118)

2024-06-13 09:07:12 +00:00

client

fix: retry on unknown error (#4138)

2024-06-13 11:15:38 +00:00

cmd

fix: explicitly set config instead of using changable default in tests (#4132)

2024-06-11 10:51:01 +00:00

common

refactor: simplify parquet writer (#4112)

2024-06-13 07:32:47 +00:00

datanode

refactor: remove substrait ser/de for region query in standalone (#3812)

2024-06-11 09:33:47 +00:00

datatypes

chore: change binary array type from LargeBinaryArray to BinaryArray (#3924)

2024-05-18 08:04:41 +00:00

file-engine

fix: display error in correct format (#4082)

2024-05-31 09:25:14 +00:00

flow

fix(flow): infer table schema correctly (#4113)

2024-06-11 08:57:47 +00:00

frontend

feat: log ingestion support (#4014)

2024-06-14 17:03:30 +00:00

index

fix: display error in correct format (#4082)

2024-05-31 09:25:14 +00:00

log-store

test: run test_flush_reopen_region and test_region_replay with KafkaLogStore (#4083)

2024-06-04 08:11:15 +00:00

meta-client

chore: run fuzz tests with kafka remote wal (#4105)

2024-06-07 03:47:40 +00:00

meta-srv

refactor: remove substrait ser/de for region query in standalone (#3812)

2024-06-11 09:33:47 +00:00

metric-engine

chore: reduce some burden on the write path (#4110)

2024-06-06 06:45:19 +00:00

mito2

refactor: add Compactor trait to abstract the compaction (#4097)

2024-06-17 03:03:47 +00:00

object-store

build(deps): upgrade opendal to 0.46 (#4037)

2024-05-27 09:12:23 +00:00

operator

feat: log ingestion support (#4014)

2024-06-14 17:03:30 +00:00

partition

fix: display the PartitionBound and PartitionDef correctly (#4101)

2024-06-04 08:10:44 +00:00

pipeline

feat: log ingestion support (#4014)

2024-06-14 17:03:30 +00:00

plugins

chore: unify name metasrv (#3671)

2024-04-09 03:03:26 +00:00

promql

fix: macro crate cannot be compiled alone (#4130)

2024-06-11 05:36:29 +00:00

puffin

build(deps): bump snafu to 0.8 (#3911)

2024-05-10 13:36:25 +00:00

query

refactor: remove substrait ser/de for region query in standalone (#3812)

2024-06-11 09:33:47 +00:00

script

build(deps): bump datafusion 20240528 (#4061)

2024-06-01 14:03:00 +00:00

servers

feat: log ingestion support (#4014)

2024-06-14 17:03:30 +00:00

session

feat: manual compaction (#3988)

2024-05-22 09:42:21 +00:00

sql

feat: Implement SHOW CREATE FLOW (#4040)

2024-06-07 03:24:56 +00:00

store-api

refactor: remove substrait ser/de for region query in standalone (#3812)

2024-06-11 09:33:47 +00:00

table

feat: Implement RegionScanner for SeqScan (#4060)

2024-06-12 08:21:30 +00:00