dcraven
ca6fd5effc
Fix bug. Cleanup some rough spots. Renamed functions. Fixed tests and docs.
2021-01-06 19:20:21 +09:00
dcraven
4e6b341422
Tests compile.
2021-01-06 19:20:21 +09:00
dcraven
a56330b234
Fix generic types in TokenChainIterator. Fix filter implementations.
2021-01-06 19:20:21 +09:00
dcraven
6af6c11ec2
Formulate more as iterators.
2021-01-06 19:20:21 +09:00
dcraven
9633d2e657
Small changes.
2021-01-06 19:20:21 +09:00
dcraven
39e8739ea5
Reformulate as Iterators, Checkpoint 2. Finished, now bubble up changes.
2021-01-06 19:20:21 +09:00
dcraven
801c82a5e1
Formulate as Iterators, Checkpoint 1.
2021-01-06 19:20:21 +09:00
dcraven
ccd0f3ccc9
Checkpoint converting to Iterators and static dispatch.
2021-01-06 19:20:21 +09:00
dcraven
f1973759ef
Remove forgotten code.
2021-01-06 19:20:21 +09:00
dcraven
2bd1d8230c
Remove unnecessary lifetime.
2021-01-06 19:20:21 +09:00
dcraven
c7407cc2a7
Simplify control flow.
2021-01-06 19:20:21 +09:00
dcraven
0150b406c5
Remove BoxTokenFilter.
2021-01-06 19:20:21 +09:00
dcraven
f73209a868
Reduced number of allocations.
2021-01-06 19:20:21 +09:00
dcraven
09375decc2
Removed unnecessary lifetimes.
2021-01-06 19:20:21 +09:00
dcraven
b8c7f1fe9c
Removed unnecessary trait impls
2021-01-06 19:20:21 +09:00
Paul Masurel
2f14a892ca
added a simple bench for the default analyzer
2021-01-06 19:11:26 +09:00
Paul Masurel
9c3cabce40
Updated version of the rand crate.
2021-01-06 18:09:00 +09:00
Paul Masurel
f8d71c2b10
Merge pull request #964 from mosuka/deserializable
...
Make NamedFieldDocument deserializable
2021-01-06 17:43:53 +09:00
Paul Masurel
394dfb24f1
Merge pull request #965 from lewisdiamond/patch-1
...
Fix spelling
2021-01-06 13:38:31 +09:00
Lewis Diamond
b0549a229d
Fix spelling
2021-01-05 22:34:56 -05:00
Minoru Osuka
670b6eaff6
Make NamedFieldDocument deserializable
2020-12-21 16:51:31 +09:00
Paul Masurel
a4f33d3823
Added comment to f64 conversion to u64.
...
- Added proptest
- Added comment to Lemire blog post.
2020-12-15 13:40:31 +09:00
Paul Masurel
c7841e3da5
Merge pull request #953 from barrotsteindev/filter-collector-tpredicatevalue
...
Generic filter collector
2020-12-14 10:35:46 +09:00
barrotsteindev
e7b4a12bba
cargo fmt
2020-12-10 14:10:55 +02:00
barrotsteindev
0aaa929d6e
Merge branch 'main' into filter-collector-tpredicatevalue
2020-12-10 11:27:19 +02:00
barrotsteindev
1112797c18
added a line to CHANGELOG.md
2020-12-10 11:25:08 +02:00
barrotsteindev
920481e1c1
change unit test
2020-12-10 11:24:53 +02:00
Paul Masurel
55f7b84966
Merge pull request #952 from tantivy-search/bm25-on-onebyte
...
Encode blockwand on a single byte.
2020-12-10 18:09:31 +09:00
Paul Masurel
09ab4df1fe
Encode blockwand on a single byte.
2020-12-10 18:08:52 +09:00
barrotsteindev
0c2cf81b37
cargo fmt
2020-12-10 11:08:35 +02:00
barrotsteindev
d864430bda
final edits
2020-12-10 11:08:15 +02:00
Paul Masurel
de60540e06
fixing compilation
2020-12-10 10:36:21 +02:00
Paul Masurel
c3e311e6b8
Removed 'static in compression_lz4.
2020-12-09 15:30:52 +09:00
barrotsteindev
ac704f2f22
WIP generic filter collector
2020-12-08 14:36:52 +02:00
Paul Masurel
be626083a0
Reorganized and added termdict unit tests.
2020-12-07 12:50:36 +09:00
Paul Masurel
b68fcca1e0
Minor changes
...
- Open{Write,Read}Error::wrap_io_error made public
- Arc<PathBuf> -> Arc<Path> in file_watcher.
2020-12-03 23:31:50 +09:00
Paul Masurel
af6dfa1856
Small refactoring
2020-12-03 14:27:05 +09:00
Paul Masurel
654c400a0b
TermDictionary.finish does not flush
2020-12-03 13:36:25 +09:00
Paul Masurel
80a99539ce
Several TermDict operation now returns an io::Result
2020-12-03 13:13:11 +09:00
Paul Masurel
4b1c770e5e
Simplified counting writer and removed flush
2020-12-03 11:24:39 +09:00
Paul Masurel
3491645e69
Moved the term merger
2020-12-03 10:24:04 +09:00
Paul Masurel
e72c8287f8
Merge pull request #951 from tantivy-search/fst-isolated
...
Fst isolated
2020-12-03 10:11:39 +09:00
Paul Masurel
b4b3bc7acd
Cargo fmt
2020-12-03 10:08:38 +09:00
Paul Masurel
521c7b271b
Isolated fst impl of termdictionary in a specific module.
2020-12-02 21:18:33 +09:00
Paul Masurel
acd888c999
Merge pull request #950 from tantivy-search/guilload--fix-clippy-warning
...
Fix clippy warning
2020-12-02 08:09:31 +09:00
Adrien Guillo
3ab1ba0b2f
Fix clippy warning
2020-12-01 12:07:53 -08:00
Paul Masurel
b344c0ac05
Merge pull request #949 from tantivy-search/docset_is_send
...
DocSet is send
2020-12-01 19:12:51 +09:00
Paul Masurel
1741619c7f
DocSet is send
2020-12-01 19:11:21 +09:00
Paul Masurel
067ba3dff0
Merge pull request #946 from tantivy-search/issue/test-bugfix-atomicwrite
...
Attempt to fix bug surfacing sometimes in test.
2020-12-01 15:29:51 +09:00
Paul Masurel
f79250f665
Fix perf regression in the benchmark for the Count collector.
...
In order to reduce IO, we introduced a way to instanciate a dummy
constant FieldnormReader which worked by allocating a buffer with
as many bytes as there are docs in the segments.
This allocation is not a negligible by any mean.
This PR works by offering two implementation for the
FieldnormReader.
The const field norm reader simply returns the same value all of the
time, while the array based one does the same as the current one.
2020-12-01 08:51:32 +09:00