mirror of
https://github.com/quickwit-oss/tantivy.git
synced 2026-11-20 17:44:15 +00:00
* Hardening unsafe in substring_count * Remove unsafe in StrColumn::ord_to_str ord_to_term may leave arbitrary bytes in the buffer when the term is not found or on error, which left an invalid UTF-8 String behind. The buffer is now only put back into the String after UTF-8 validation. On not found or error, the output is left empty. * Make CompactDoc::node_data crate private extract_str relies on string values in node_data being valid UTF-8. With a public field, safe code could break this invariant. * Remove unsafe in Term::get_json_path The public Term API (append_bytes, set_bytes, Term::wrap, serde, ...) can put arbitrary bytes in the json path. Invalid UTF-8 sequences are now replaced by U+FFFD. * LZ4 doc store: never hand back a buffer with uninitialized bytes compress/decompress now work on a local Vec while it contains uninitialized bytes, and clear it on error. On error or panic, the caller's buffer is left empty. Buffer reuse is preserved.