rust/greptimedb
1
0
Fork 0
mirror of https://github.com/GreptimeTeam/greptimedb.git synced 2026-05-31 20:30:37 +00:00
Code Issues Packages Projects Releases Wiki Activity

refactor: cache inverted index with fixed-size page (#5114)

Browse Source 
* feat: cache inverted index by page instead of file

* fix: add unit test and fix bugs

* chore: typo

* chore: ci

* fix: math

* chore: apply review comments

* chore: renames

* test: add unit test for index key calculation

* refactor: use ReadableSize

* feat: add config for inverted index page size

* chore: update config file

* refactor: handle multiple range read and fix some related bugs

* fix: add config

* test: turn to a fs reader to match behaviors of object store
This commit is contained in:
Yohan Wal
2024-12-13 15:34:24 +08:00
committed by Yingwen
parent 8b1484c064
commit fdccf4ff84
18 changed files with 434 additions and 69 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
src/common/base/src/range_read.rs
View File

@@ -205,9 +205,7 @@ impl RangeReader for Vec<u8> {
})
}
async fn read(&mut self, mut range: Range<u64>) -> io::Result<Bytes> {
range.end = range.end.min(self.len() as u64);
async fn read(&mut self, range: Range<u64>) -> io::Result<Bytes> {
let bytes = Bytes::copy_from_slice(&self[range.start as usize..range.end as usize]);
Ok(bytes)
}