2 Commits
Author SHA1 Message Date
Paul Masurel 6bced0ba02 Add the plain codec format to the columnar (#3179)
* Add the plain codec format to the columnar

Adds StrColumnCodec, the column key code of plain columns, the V3
columnar version, and the plain column storage: OnPair16 blocks of at
most 65,536 values and 1 MiB, block index, and reader.

The columnar writer does not produce plain columns yet.

* less result moar panic

* CR Comment. Making PlainColumn Inner type private

* CR comment: checked sorted index in block index.
2026-10-26 11:09:47 +01:00
Pascal Seitz e7daf69de9 use usize in bitpacker
use usize in bitpacker to enable larger columns in the columnar store

Godbolt comparison with u32 vs u64 for get access: https://godbolt.org/z/cjf7nenYP

Add a mini-tool to inspect columnar files created by tantivy. (very basic functionality which can be extended later)
2025-02-20 15:39:10 +01:00