PSeitz 1e7cd48cfa remove allocations in split compound words (#2080) ...

* remove allocations in split compound words

* clear reused data

2023-07-13 09:43:02 +09:00

..

stop_word_filter

tokenizer-api: reduce Tokenizer overhead (#2062)

2023-06-08 18:37:58 +08:00

alphanum_only.rs

tokenizer-api: reduce Tokenizer overhead (#2062)

2023-06-08 18:37:58 +08:00

ascii_folding_filter.rs

tokenizer-api: reduce Tokenizer overhead (#2062)

2023-06-08 18:37:58 +08:00

empty_tokenizer.rs

tokenizer-api: reduce Tokenizer overhead (#2062)

2023-06-08 18:37:58 +08:00

facet_tokenizer.rs

tokenizer-api: reduce Tokenizer overhead (#2062)

2023-06-08 18:37:58 +08:00

lower_caser.rs

tokenizer-api: reduce Tokenizer overhead (#2062)

2023-06-08 18:37:58 +08:00

mod.rs

Make TextAnalyzerBuilder publically accessible (#2097)

2023-06-22 11:24:21 +09:00

ngram_tokenizer.rs

Ngram tokenizer now returns an error with invalid arguments.

2023-06-25 20:13:24 +02:00

raw_tokenizer.rs

tokenizer-api: reduce Tokenizer overhead (#2062)

2023-06-08 18:37:58 +08:00

regex_tokenizer.rs

tokenizer-api: reduce Tokenizer overhead (#2062)

2023-06-08 18:37:58 +08:00

remove_long.rs

tokenizer-api: reduce Tokenizer overhead (#2062)

2023-06-08 18:37:58 +08:00

simple_tokenizer.rs

tokenizer-api: reduce Tokenizer overhead (#2062)

2023-06-08 18:37:58 +08:00

split_compound_words.rs

remove allocations in split compound words (#2080)

2023-07-13 09:43:02 +09:00

stemmer.rs

tokenizer-api: reduce Tokenizer overhead (#2062)

2023-06-08 18:37:58 +08:00

tokenized_string.rs

Improvements to doc linking, grammar, etc.

2022-09-19 18:10:22 +07:00

tokenizer_manager.rs

tokenizer-api: reduce Tokenizer overhead (#2062)

2023-06-08 18:37:58 +08:00

tokenizer.rs

Clean comment on 'TextAnalyzerBuilder::filter_dynamic' method.

2023-07-03 18:45:59 +02:00

whitespace_tokenizer.rs

tokenizer-api: reduce Tokenizer overhead (#2062)

2023-06-08 18:37:58 +08:00