Arpad Müller 41fb838799 Fix tiered compaction k-merge bug and use in-memory alternative (#7661) ...

This PR does two things:

First, it fixes a bug with tiered compaction's k-merge implementation.
It ignored the lsn of a key during ordering, so multiple updates of the
same key could be read in arbitrary order, say from different layers.
For example there is layers `[(a, 2),(b, 3)]` and `[(a, 1),(c, 2)]` in
the heap, they might return `(a,2)` and `(a,1)`.

Ultimately, this change wasn't enough to fix the ordering issues in
#7296, in other words there is likely still bugs in the k-merge. So as
the second thing, we switch away from the k-merge to an in-memory based
one, similar to #4839, but leave the code around to be improved and
maybe switched to later on.

Part of #7296

2024-05-09 16:01:16 +02:00

..

src

Fix tiered compaction k-merge bug and use in-memory alternative (#7661)

2024-05-09 16:01:16 +02:00

tests

Improve tiered compaction tests (#7643)

2024-05-08 13:22:55 +02:00

Cargo.toml

Remove async_trait from CompactionDeltaLayer (#7342)

2024-04-08 14:59:08 +02:00

TODO.md

Add new compaction abstraction, simulator, and implementation. (#6830)

2024-02-27 17:15:46 +01:00