feat: write manifests in background tasks (#3709)

* chore: truncate wip

* feat: truncate and edit write manifest in background

* refactor: wrap in manifest context

* feat: alter write manifest in background

* chore: fix compiler errors

* feat: flush update manifest in background

* feat: compaction update manifest in background

* feat: set dropping state

* feat: reset drop state

* feat: check state before updating manifest

* test: fix compaction test

* refactor: rename method

* chore: update comment

* chore: discard state guard

* refactor: use atomic cell to store state enum

* chore: fix clippy

* chore: update toml

* chore: remove unused type alias

* feat: check state after writing manifest

* chore: address CR comments

* chore: change status code

* chore: Update src/mito2/src/region.rs

Co-authored-by: Lei, HUANG <6406592+v0y4g3r@users.noreply.github.com>

* fix: executes applier

---------

Co-authored-by: Lei, HUANG <6406592+v0y4g3r@users.noreply.github.com>
This commit is contained in:
Yingwen
2024-04-24 11:09:48 +08:00
committed by GitHub
parent 86a989517e
commit 4685b59ef1
28 changed files with 818 additions and 367 deletions

1
Cargo.lock generated
View File

@@ -5416,6 +5416,7 @@ dependencies = [
"common-wal",
"crc32fast",
"criterion",
"crossbeam-utils",
"datafusion",
"datafusion-common",
"datafusion-expr",