rust/tantivy
1
0
Fork 0
mirror of https://github.com/quickwit-oss/tantivy.git synced 2026-08-20 04:58:19 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
1f06997d047a8032cd306bcbf96f18428ccbddc2
tantivy/tokenizer-api
T
History
trinity-1686a 064518156f refactor tokenization pipeline to use GATs (#1924) 
* refactor tokenization pipeline to use GATs

* fix doctests

* fix clippy lints

* remove commented code
2023-03-09 09:39:37 +01:00
..
src
refactor tokenization pipeline to use GATs (#1924)
2023-03-09 09:39:37 +01:00
Cargo.toml
Add license to tokenizer-api crate (#1778)
2023-01-11 05:26:41 +01:00
README.md
move tokenizer API to seperate crate (#1767)
2023-01-09 06:37:38 +01:00

README.md

#Tokenizer-API

An API to interface a tokenizer with tantivy.

The API will be kept stable in order to not break support for existing tokenizers.

Reference in New Issue View Git Blame Copy Permalink