rust/tantivy
1
0
Fork 0
mirror of https://github.com/quickwit-oss/tantivy.git synced 2025-12-23 02:29:57 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
ad4c940fa350877cd3f2bda14077123c585264ec
tantivy/tokenizer-api
History
Paul Masurel ad4c940fa3 proof of concept for dynamic tokenizer.
2023-07-03 22:05:10 +09:00
..
src
proof of concept for dynamic tokenizer.
2023-07-03 22:05:10 +09:00
Cargo.toml
release tantivy (#2083)
2023-06-09 10:47:46 +02:00
README.md
move tokenizer API to seperate crate (#1767)
2023-01-09 06:37:38 +01:00

README.md

#Tokenizer-API

An API to interface a tokenizer with tantivy.

The API will be kept stable in order to not break support for existing tokenizers.