rust/tantivy
1
0
Fork 0
mirror of https://github.com/quickwit-oss/tantivy.git synced 2025-12-23 02:29:57 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
8459efa32cb1dc22477e9fff418c78806e88ae6e
tantivy/tokenizer-api
History
trinity-1686a 064518156f refactor tokenization pipeline to use GATs (#1924) 
* refactor tokenization pipeline to use GATs

* fix doctests

* fix clippy lints

* remove commented code
2023-03-09 09:39:37 +01:00
..
src
refactor tokenization pipeline to use GATs (#1924)
2023-03-09 09:39:37 +01:00
Cargo.toml
Add license to tokenizer-api crate (#1778)
2023-01-11 05:26:41 +01:00
README.md
move tokenizer API to seperate crate (#1767)
2023-01-09 06:37:38 +01:00

README.md

#Tokenizer-API

An API to interface a tokenizer with tantivy.

The API will be kept stable in order to not break support for existing tokenizers.