Paul Masurel afe0134d0f Kkoziara remove tokens from doc store (#715) ...

* Prevent tokens from being stored in the document store.

Commit adds prepare_for_store method to Document, which changes all
PreTokenizedString values into String values. The method is called
before adding document to the document store to prevent tokens from
being saved there. Commit also adds small changes to comments in
pre_tokenized_text example.

* Avoid storing the pretokenized text.

2019-11-25 22:39:12 +09:00

..

basic_search.rs

Update import statements in examples, doctests (#633)

2019-08-19 07:26:35 +09:00

custom_collector.rs

Update import statements in examples, doctests (#633)

2019-08-19 07:26:35 +09:00

custom_tokenizer.rs

Update import statements in examples, doctests (#633)

2019-08-19 07:26:35 +09:00

deleting_updating_documents.rs

Update import statements in examples, doctests (#633)

2019-08-19 07:26:35 +09:00

faceted_search.rs

Update import statements in examples, doctests (#633)

2019-08-19 07:26:35 +09:00

integer_range_search.rs

Update import statements in examples, doctests (#633)

2019-08-19 07:26:35 +09:00

iterating_docs_and_positions.rs

Update import statements in examples, doctests (#633)

2019-08-19 07:26:35 +09:00

multiple_producer.rs

Moving queyr grammar to a different crate. (#645)

2019-09-05 09:37:28 +09:00

pre_tokenized_text.rs

Kkoziara remove tokens from doc store (#715)

2019-11-25 22:39:12 +09:00

snippet.rs

Update import statements in examples, doctests (#633)

2019-08-19 07:26:35 +09:00

stop_words.rs

Update import statements in examples, doctests (#633)

2019-08-19 07:26:35 +09:00

working_with_json.rs

Tiqb feature/2018 (#583)

2019-07-01 10:01:46 +09:00