Pascal Seitz
24274edf81
remove trait impl fpr &Vec
2021-06-30 09:50:47 +02:00
Paul Masurel
d58497529b
Fixed CHANGELOG to include 0.15.2.
2021-06-30 16:34:47 +09:00
Pascal Seitz
130495abab
cleanup
2021-06-30 08:57:55 +02:00
Pascal Seitz
9b743d60fb
make docid mapping non optional
...
make docid mapping non optional
add trivial flag for docid mapping
add time measurements
2021-06-30 08:57:55 +02:00
Pascal Seitz
5c9e2ef036
wrap docidmapping in struct
2021-06-30 08:57:55 +02:00
Pascal Seitz
8526434b63
add dynamic fastfield case
...
add dynamic fastfield for single fast field unsorted
fix scary documentation bug
add num_len instead of len
2021-06-30 08:57:55 +02:00
Pascal Seitz
6ba302c481
Use dynamic fastfield codes for multivalues fixes #1093
...
Use dynamic fastfield codes for multivalues fixes (only sorting case covered)
Rename get to get_val due to conflict with Vec
use u64 precision instead of u32 for get_range, to allow use of existing fast field interface interface (actually not sure if it would be better have a different interface)
2021-06-30 08:57:55 +02:00
Paul Masurel
de92f094aa
Closes #1101 fix delete documents with sort by field
...
Closes #1101
* fix delete documents with sort by field
Co-authored-by: Andre-Philippe Paquet <appaquet@gmail.com >
2021-06-30 15:51:32 +09:00
Evance Soumaoro
c82cee66de
exposing min/max value interface on MultiValuedFastField Reader ( #1096 )
2021-06-23 17:38:50 +09:00
Paul Masurel
6eed05b1ce
Revert "Exposing min/max value interface on MultiValuedFastField Reader ( #1094 )" ( #1095 )
...
This reverts commit bb488305c9
2021-06-23 10:25:11 +09:00
Evance Soumaoro
bb488305c9
Exposing min/max value interface on MultiValuedFastField Reader ( #1094 )
...
Exposing min/max value interface on MultiValuedFastField Reader
2021-06-23 08:51:36 +09:00
PSeitz
f05e84f964
add FieldEntry constructor, closes #1086 ( #1090 )
2021-06-17 10:15:48 +09:00
PSeitz
65546ed22b
Merge pull request #1088 from appaquet/fix/store-reader-iterator-take2
...
Fix corruption in store reader iterator, take 2
2021-06-16 14:44:00 +02:00
Andre-Philippe Paquet
57ae5b27dc
fix store reader iterator, take 2
2021-06-16 07:51:39 -04:00
PSeitz
f9531ec3c9
Merge pull request #1085 from PSeitz/fastfieldcompression
...
use concrete return type, fixes #1084
2021-06-16 13:07:12 +02:00
Pascal Seitz
5b54a32563
use concrete return type, fixes #1084
2021-06-16 12:03:11 +02:00
PSeitz
cd049e28bc
Merge pull request #1082 from PSeitz/fastfieldcompression
...
use dynamic fast field codec for offset index
2021-06-16 11:59:00 +02:00
PSeitz
646e41bec4
Merge pull request #1083 from PSeitz/termdict_block_layout
...
Move counting writer to common
2021-06-16 08:57:55 +02:00
Pascal Seitz
36528c5e83
move counting writer to common
...
move counting writer to common
reuse counting writer in fastfield codec
2021-06-16 08:14:04 +02:00
Pascal Seitz
cd169dee23
use dynamic fast field codec for offset index
2021-06-15 13:34:42 +02:00
PSeitz
b5cc60f80b
Merge pull request #1080 from PSeitz/more_tests
...
test all features in github actions
2021-06-15 10:51:57 +02:00
Pascal Seitz
060b83159a
use nightly for tests
2021-06-15 10:08:49 +02:00
Pascal Seitz
a40ff35453
test all features
2021-06-15 09:31:39 +02:00
PSeitz
268e6bfe6e
update fast field codec readme
2021-06-15 09:19:39 +02:00
PSeitz
f902440b8b
Merge pull request #1072 from PSeitz/fastfieldcompression
...
Enable support for multiple fastfield codecs, add linear interpolation
2021-06-15 09:07:17 +02:00
Pascal Seitz
77a0902605
replace unwrap, use vec in bench
2021-06-14 17:01:46 +02:00
Pascal Seitz
c889ae10e4
add is_applicable to fast field codecs
2021-06-14 16:16:25 +02:00
Pascal Seitz
0a534c6ee0
rename create to serialize
2021-06-14 15:40:07 +02:00
Pascal Seitz
167d88b449
fix tests behind unstable feature flag
2021-06-14 15:31:12 +02:00
Pascal Seitz
1071ed84f2
fix cond compilation
2021-06-14 14:05:04 +02:00
Pascal Seitz
abb5624af2
add contributing guidelines, add codec comparer binary
...
add contributing guidelines
add codec comparer binary to test codec compressions with different test data sets
2021-06-14 13:56:40 +02:00
Pascal Seitz
1d41b96d32
rename, add codec_tester
2021-06-14 13:56:40 +02:00
Pascal Seitz
ef4665945f
rename file
2021-06-14 13:56:40 +02:00
Pascal Seitz
294cd5fd0b
streamline traits and tests
2021-06-14 13:56:40 +02:00
Pascal Seitz
f4d271177c
add inline, add readme
2021-06-14 13:56:40 +02:00
Pascal Seitz
451538fecf
add serialize for bool
2021-06-14 13:56:40 +02:00
Pascal Seitz
e78e0fec59
add multilinearinterpolation
...
add multilinearinterpolation, which compresses blocks of size 512
add checks for linear interpolation
2021-06-14 13:56:40 +02:00
Pascal Seitz
2e639cebf8
fix bitpacker bug, reset internal value
2021-06-14 13:56:40 +02:00
Pascal Seitz
e296da7ade
add debug and failsafes
2021-06-14 13:56:40 +02:00
Pascal Seitz
3b3e26c4b8
use f64 precision for slope calculation
2021-06-14 13:56:40 +02:00
Pascal Seitz
6a4883ac69
use uniform distribution sampling
2021-06-14 13:56:40 +02:00
Pascal Seitz
0ba05df545
add f32::MAX to disable a compressor
2021-06-14 13:56:40 +02:00
Pascal Seitz
aa3c4d4029
use f32 precision, add inline
2021-06-14 13:56:40 +02:00
Pascal Seitz
60df629725
cargo.toml license desc and author
2021-06-14 13:56:40 +02:00
Pascal Seitz
2570b005ac
fix estimation test
2021-06-14 13:56:40 +02:00
Pascal Seitz
d5212cd19d
fix clippy
2021-06-14 13:56:40 +02:00
Pascal Seitz
2193d85622
fix clippy and common crate tests
2021-06-14 13:56:40 +02:00
Pascal Seitz
dfdbfe9eff
add benchmark for fast field codecs
...
test tests::bench_fastfield_bitpack_create ... bench: 57,628 ns/iter (+/- 23,486)
test tests::bench_fastfield_bitpack_get ... bench: 43,323 ns/iter (+/- 4,286)
test tests::bench_fastfield_linearinterpol_create ... bench: 223,625 ns/iter (+/- 33,563)
test tests::bench_fastfield_linearinterpol_get ... bench: 82,839 ns/iter (+/- 9,575)
2021-06-14 13:56:40 +02:00
Pascal Seitz
b999e836b2
replace BitpackedFastFieldReader, delete FastFieldSerializer trait
2021-06-14 13:56:40 +02:00
Pascal Seitz
be2dd41e69
add interface to create and read codecs
...
add CodecReader as common interface in fastfield codec crate
add LinearInterpolation to DynamicFastFieldReader
calc estimation and choose best codec
cleanup
2021-06-14 13:56:40 +02:00
