rust/tantivy
1
0
Fork 0
mirror of https://github.com/quickwit-oss/tantivy.git synced 2026-05-21 10:40:41 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
f85d0a522af63f7dd0b1511a344bc5db6df88638
tantivy/src/tokenizer
History
Paul Masurel 811fd0cb9e Dynamic analyzer (#755) 
* Removed generics in tokenizers

* lowercaser

* Added TokenizerExt

* Introducing BoxedTokenizer

* Introducing BoxXXXXX helper struct

* Closes #762.

* Introducing a TextAnalyzer
2020-01-29 18:23:37 +09:00
..
alphanum_only.rs
Dynamic analyzer (#755)
2020-01-29 18:23:37 +09:00
ascii_folding_filter.rs
Dynamic analyzer (#755)
2020-01-29 18:23:37 +09:00
facet_tokenizer.rs
Dynamic analyzer (#755)
2020-01-29 18:23:37 +09:00
lower_caser.rs
Dynamic analyzer (#755)
2020-01-29 18:23:37 +09:00
mod.rs
Dynamic analyzer (#755)
2020-01-29 18:23:37 +09:00
ngram_tokenizer.rs
Dynamic analyzer (#755)
2020-01-29 18:23:37 +09:00
raw_tokenizer.rs
Dynamic analyzer (#755)
2020-01-29 18:23:37 +09:00
remove_long.rs
Dynamic analyzer (#755)
2020-01-29 18:23:37 +09:00
simple_tokenizer.rs
Dynamic analyzer (#755)
2020-01-29 18:23:37 +09:00
stemmer.rs
Dynamic analyzer (#755)
2020-01-29 18:23:37 +09:00
stop_word_filter.rs
Dynamic analyzer (#755)
2020-01-29 18:23:37 +09:00
token_stream_chain.rs
Dynamic analyzer (#755)
2020-01-29 18:23:37 +09:00
tokenized_string.rs
Dynamic analyzer (#755)
2020-01-29 18:23:37 +09:00
tokenizer_manager.rs
Dynamic analyzer (#755)
2020-01-29 18:23:37 +09:00
tokenizer.rs
Dynamic analyzer (#755)
2020-01-29 18:23:37 +09:00