mirror of
https://github.com/quickwit-oss/tantivy.git
synced 2025-12-23 02:29:57 +00:00
514d23a20c
closes #1766 Finding tantivy tokenizers is a frustrating experience currently, since they need be updated for each tantivy version. That's unnecessary since the API is rather stable anyway.
7 lines
148 B
Markdown
7 lines
148 B
Markdown
|
|
#Tokenizer-API
|
|
|
|
An API to interface a tokenizer with tantivy.
|
|
|
|
The API will be kept stable in order to not break support for existing tokenizers.
|