mirror of
https://github.com/quickwit-oss/tantivy.git
synced 2026-11-20 17:44:15 +00:00
- Replace `TermOrdMemo::get`/`set` by `get_or_eval`, and store the result for a doc without an input value in slot 0 (term ord `o` in slot `o + 1`) instead of a separate field. - Index the memo directly: a term ord out of the input dictionary is a corrupted column, which panics like the rest of the module. - Destructure the source once per block, and evaluate misses with a free `eval_single_input`, instead of a per-doc `memoized_result` method. - Share the cardinality tail of the two `load_block` paths, and implement `InputColumn::load_block` on top of `load_block_values`. - Drop the test-only memo threshold: the limit test builds a dictionary of `TERM_ORD_MEMO_MAX_NUM_TERMS + 1` terms, and the other tests exercise the memo for their small dictionaries. jitexpr_agg_bench: terms on (REGEXP_EXTRACT service ..) 7.7 ms -> 6.8 ms, on (UPPER service) 8.0 ms -> 6.8 ms; the other cases are unchanged.