Paul Masurel 483b1d13d4 Added unit test for long tokens (#1635) ...

* Bugfix on long tokens and multivalue text fields.

Fixes a minor bug for the strong edge case
in which a tokenizer would emit tokens where
the last token does not cover the last position.

More importantly, this adds unit tests.

Closes #1634

* Update src/indexer/segment_writer.rs

Co-authored-by: PSeitz <PSeitz@users.noreply.github.com>

Co-authored-by: PSeitz <PSeitz@users.noreply.github.com>

2022-10-20 15:05:37 +09:00

..

compression

Fix warnings when doc'ing private items. (#1579)

2022-10-03 14:24:00 +09:00

stacker

fix: Fix power of two computation on 32bit architectures (#1624)

2022-10-18 11:55:02 +09:00

block_search.rs

Documentation improvements.

2022-09-18 18:05:37 +07:00

block_segment_postings.rs

Fix typos and markdowns

2022-08-13 18:25:47 +08:00

indexing_context.rs

Adding an IndexingContext object (#1268)

2022-02-04 15:08:01 +09:00

json_postings_writer.rs

rename NothingRecorder to DocIdRecorder (#1615)

2022-10-13 15:43:40 +09:00

mod.rs

Tidy up clippy config. (#1547)

2022-09-26 09:37:55 +09:00

per_field_postings_writer.rs

rename NothingRecorder to DocIdRecorder (#1615)

2022-10-13 15:43:40 +09:00

postings_writer.rs

Added unit test for long tokens (#1635)

2022-10-20 15:05:37 +09:00

postings.rs

Fix typos and markdowns

2022-08-13 18:25:47 +08:00

recorder.rs

rename NothingRecorder to DocIdRecorder (#1615)

2022-10-13 15:43:40 +09:00

segment_postings.rs

docs: "associated to" -> "associated with" (#1557)

2022-09-26 20:23:37 +09:00

serializer.rs

doc fix (#1391)

2022-06-21 15:53:33 +09:00

skip.rs

Replace deprecated std package's constants on floats and integers (#1420)

2022-07-22 08:05:08 +09:00

term_info.rs

docs: "associated to" -> "associated with" (#1557)

2022-09-26 20:23:37 +09:00