feat(mito): avoid buffering all batches for the same primary key (#2658)

* feat: Control merge reader by batch size

* test: test heap have large range

* fix: merge one batch

* test: merge many duplicates

* test: test reheap hot

* feat: don't handle empty batch in merge reader
This commit is contained in:
Yingwen
2023-10-31 14:36:31 +08:00
committed by GitHub
parent 88eb69530a
commit 465c8f714e
2 changed files with 647 additions and 316 deletions

File diff suppressed because it is too large Load Diff

View File

@@ -582,7 +582,9 @@ impl MergeReader {
// Now key range of this node is behind the hottest node's.
node.is_behind(hottest)
} else {
false
// Setting this to false should not affect correctness but performance because
// `refille_hot()` ensures the hottest node is correct.
true
};
if node_is_cold {