Antoine G
a41d3d51a4
Update fastfield_codecs/src/lib.rs
2022-03-03 11:25:06 +01:00
Saroh
cae34ffe47
update fastfield doc
2022-03-02 16:04:15 +01:00
Paul Masurel
9815067171
Minor changes
2022-02-21 13:55:01 +09:00
Paul Masurel
2069e3e52b
Fixing clippy comments
2022-02-01 10:24:05 +09:00
Paul Masurel
eca6628b3c
Minor refactoring ( #1266 )
2022-01-28 15:55:55 +09:00
PSeitz
f27ae04282
fix slope calculation in multilinear interpol ( #1161 )
...
add test to check for compression
2021-09-27 10:14:03 +09:00
PSeitz
ff4813529e
add comments on compression ( #1119 )
2021-07-26 22:54:22 +09:00
Pascal Seitz
e6427b2588
cleanup
2021-07-02 09:21:22 +02:00
Pascal Seitz
9b3e508753
fix clippy
2021-07-01 18:06:09 +02:00
Pascal Seitz
a1ac63ee1c
fix clippy
2021-07-01 18:06:03 +02:00
Pascal Seitz
2de249af74
clippy fixes
2021-07-01 17:37:37 +02:00
Pascal Seitz
10f056fbb4
apply clippy fixes
2021-07-01 17:08:44 +02:00
Pascal Seitz
24274edf81
remove trait impl fpr &Vec
2021-06-30 09:50:47 +02:00
Pascal Seitz
6ba302c481
Use dynamic fastfield codes for multivalues fixes #1093
...
Use dynamic fastfield codes for multivalues fixes (only sorting case covered)
Rename get to get_val due to conflict with Vec
use u64 precision instead of u32 for get_range, to allow use of existing fast field interface interface (actually not sure if it would be better have a different interface)
2021-06-30 08:57:55 +02:00
PSeitz
cd049e28bc
Merge pull request #1082 from PSeitz/fastfieldcompression
...
use dynamic fast field codec for offset index
2021-06-16 11:59:00 +02:00
Pascal Seitz
36528c5e83
move counting writer to common
...
move counting writer to common
reuse counting writer in fastfield codec
2021-06-16 08:14:04 +02:00
Pascal Seitz
cd169dee23
use dynamic fast field codec for offset index
2021-06-15 13:34:42 +02:00
Pascal Seitz
77a0902605
replace unwrap, use vec in bench
2021-06-14 17:01:46 +02:00
Pascal Seitz
c889ae10e4
add is_applicable to fast field codecs
2021-06-14 16:16:25 +02:00
Pascal Seitz
0a534c6ee0
rename create to serialize
2021-06-14 15:40:07 +02:00
Pascal Seitz
abb5624af2
add contributing guidelines, add codec comparer binary
...
add contributing guidelines
add codec comparer binary to test codec compressions with different test data sets
2021-06-14 13:56:40 +02:00
Pascal Seitz
1d41b96d32
rename, add codec_tester
2021-06-14 13:56:40 +02:00
Pascal Seitz
ef4665945f
rename file
2021-06-14 13:56:40 +02:00
Pascal Seitz
294cd5fd0b
streamline traits and tests
2021-06-14 13:56:40 +02:00
Pascal Seitz
f4d271177c
add inline, add readme
2021-06-14 13:56:40 +02:00
Pascal Seitz
e78e0fec59
add multilinearinterpolation
...
add multilinearinterpolation, which compresses blocks of size 512
add checks for linear interpolation
2021-06-14 13:56:40 +02:00
Pascal Seitz
e296da7ade
add debug and failsafes
2021-06-14 13:56:40 +02:00
Pascal Seitz
3b3e26c4b8
use f64 precision for slope calculation
2021-06-14 13:56:40 +02:00
Pascal Seitz
6a4883ac69
use uniform distribution sampling
2021-06-14 13:56:40 +02:00
Pascal Seitz
0ba05df545
add f32::MAX to disable a compressor
2021-06-14 13:56:40 +02:00
Pascal Seitz
aa3c4d4029
use f32 precision, add inline
2021-06-14 13:56:40 +02:00
Pascal Seitz
2570b005ac
fix estimation test
2021-06-14 13:56:40 +02:00
Pascal Seitz
2193d85622
fix clippy and common crate tests
2021-06-14 13:56:40 +02:00
Pascal Seitz
be2dd41e69
add interface to create and read codecs
...
add CodecReader as common interface in fastfield codec crate
add LinearInterpolation to DynamicFastFieldReader
calc estimation and choose best codec
cleanup
2021-06-14 13:56:40 +02:00
Pascal Seitz
483fdb79cc
add linear interpolation estimation
...
add estimation tests
add codec test data in tests
2021-06-14 13:56:40 +02:00
Pascal Seitz
aefd0fc907
refactor, add fastfield metadata to footer
...
change api to fastfield reader in codec crate
add fastfield metadata to footer
remove old code
merge codec files
2021-06-14 13:56:40 +02:00
Pascal Seitz
3298d6cb71
move common to common crate, create fastfield_codecs crate
...
move common to common crate
create fastfield_codecs crate
add bitpacker to fast field codecs
add linear interpolation to fast field codecs
add tests
2021-06-14 13:56:40 +02:00
