Pascal Seitz
6a9d09cf7a
handle gcd like a composable codec
2022-07-28 09:54:35 +02:00
Pascal Seitz
fff1a03842
replace generic with impl T
2022-07-21 14:26:45 +02:00
Pascal Seitz
7e032a9efd
apply gcd on fastfield as preprocessing
2022-07-20 16:19:47 +02:00
Evance Soumaoro
a4be239d38
Updated DateTime to hold timestamp in microseconds, while making date field precision configurable ( #1396 )
2022-07-12 10:04:28 +09:00
Pascal Seitz
02691f2445
edition 2021 for subcrates
2022-07-04 14:19:32 +08:00
dependabot[bot]
fc24842a43
Update more-asserts requirement from 0.2.1 to 0.3.0 ( #1384 )
...
Updates the requirements on [more-asserts](https://github.com/thomcc/rust-more-asserts ) to permit the latest version.
- [Release notes](https://github.com/thomcc/rust-more-asserts/releases )
- [Commits](https://github.com/thomcc/rust-more-asserts/compare/v0.2.2...v0.3.0 )
---
updated-dependencies:
- dependency-name: more-asserts
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-06-10 10:38:28 +09:00
Paul Masurel
f0a2b1cc44
Bumped tantivy and subcrate versions.
2022-05-25 22:50:33 +09:00
Paul Masurel
2e255c4bef
Preparing for release
2022-03-09 09:59:08 +09:00
Antoine G
a41d3d51a4
Update fastfield_codecs/src/lib.rs
2022-03-03 11:25:06 +01:00
Saroh
cae34ffe47
update fastfield doc
2022-03-02 16:04:15 +01:00
Paul Masurel
9815067171
Minor changes
2022-02-21 13:55:01 +09:00
Paul Masurel
2069e3e52b
Fixing clippy comments
2022-02-01 10:24:05 +09:00
Paul Masurel
eca6628b3c
Minor refactoring ( #1266 )
2022-01-28 15:55:55 +09:00
PSeitz
f27ae04282
fix slope calculation in multilinear interpol ( #1161 )
...
add test to check for compression
2021-09-27 10:14:03 +09:00
Paul Masurel
9f32b22602
Preparing for release.
2021-08-26 09:07:08 +09:00
Pascal Seitz
3e8f267e33
rename common to tantivy-common
2021-08-19 10:27:20 +01:00
PSeitz
ff4813529e
add comments on compression ( #1119 )
2021-07-26 22:54:22 +09:00
Pascal Seitz
0b1add0ec6
move rand to optional dependencies
...
closes #1117
2021-07-21 17:49:24 +01:00
Pascal Seitz
e6427b2588
cleanup
2021-07-02 09:21:22 +02:00
Pascal Seitz
9b3e508753
fix clippy
2021-07-01 18:06:09 +02:00
Pascal Seitz
a1ac63ee1c
fix clippy
2021-07-01 18:06:03 +02:00
Pascal Seitz
2de249af74
clippy fixes
2021-07-01 17:37:37 +02:00
Pascal Seitz
10f056fbb4
apply clippy fixes
2021-07-01 17:08:44 +02:00
Pascal Seitz
24274edf81
remove trait impl fpr &Vec
2021-06-30 09:50:47 +02:00
Pascal Seitz
6ba302c481
Use dynamic fastfield codes for multivalues fixes #1093
...
Use dynamic fastfield codes for multivalues fixes (only sorting case covered)
Rename get to get_val due to conflict with Vec
use u64 precision instead of u32 for get_range, to allow use of existing fast field interface interface (actually not sure if it would be better have a different interface)
2021-06-30 08:57:55 +02:00
PSeitz
cd049e28bc
Merge pull request #1082 from PSeitz/fastfieldcompression
...
use dynamic fast field codec for offset index
2021-06-16 11:59:00 +02:00
Pascal Seitz
36528c5e83
move counting writer to common
...
move counting writer to common
reuse counting writer in fastfield codec
2021-06-16 08:14:04 +02:00
Pascal Seitz
cd169dee23
use dynamic fast field codec for offset index
2021-06-15 13:34:42 +02:00
PSeitz
268e6bfe6e
update fast field codec readme
2021-06-15 09:19:39 +02:00
Pascal Seitz
77a0902605
replace unwrap, use vec in bench
2021-06-14 17:01:46 +02:00
Pascal Seitz
c889ae10e4
add is_applicable to fast field codecs
2021-06-14 16:16:25 +02:00
Pascal Seitz
0a534c6ee0
rename create to serialize
2021-06-14 15:40:07 +02:00
Pascal Seitz
1071ed84f2
fix cond compilation
2021-06-14 14:05:04 +02:00
Pascal Seitz
abb5624af2
add contributing guidelines, add codec comparer binary
...
add contributing guidelines
add codec comparer binary to test codec compressions with different test data sets
2021-06-14 13:56:40 +02:00
Pascal Seitz
1d41b96d32
rename, add codec_tester
2021-06-14 13:56:40 +02:00
Pascal Seitz
ef4665945f
rename file
2021-06-14 13:56:40 +02:00
Pascal Seitz
294cd5fd0b
streamline traits and tests
2021-06-14 13:56:40 +02:00
Pascal Seitz
f4d271177c
add inline, add readme
2021-06-14 13:56:40 +02:00
Pascal Seitz
e78e0fec59
add multilinearinterpolation
...
add multilinearinterpolation, which compresses blocks of size 512
add checks for linear interpolation
2021-06-14 13:56:40 +02:00
Pascal Seitz
e296da7ade
add debug and failsafes
2021-06-14 13:56:40 +02:00
Pascal Seitz
3b3e26c4b8
use f64 precision for slope calculation
2021-06-14 13:56:40 +02:00
Pascal Seitz
6a4883ac69
use uniform distribution sampling
2021-06-14 13:56:40 +02:00
Pascal Seitz
0ba05df545
add f32::MAX to disable a compressor
2021-06-14 13:56:40 +02:00
Pascal Seitz
aa3c4d4029
use f32 precision, add inline
2021-06-14 13:56:40 +02:00
Pascal Seitz
60df629725
cargo.toml license desc and author
2021-06-14 13:56:40 +02:00
Pascal Seitz
2570b005ac
fix estimation test
2021-06-14 13:56:40 +02:00
Pascal Seitz
2193d85622
fix clippy and common crate tests
2021-06-14 13:56:40 +02:00
Pascal Seitz
dfdbfe9eff
add benchmark for fast field codecs
...
test tests::bench_fastfield_bitpack_create ... bench: 57,628 ns/iter (+/- 23,486)
test tests::bench_fastfield_bitpack_get ... bench: 43,323 ns/iter (+/- 4,286)
test tests::bench_fastfield_linearinterpol_create ... bench: 223,625 ns/iter (+/- 33,563)
test tests::bench_fastfield_linearinterpol_get ... bench: 82,839 ns/iter (+/- 9,575)
2021-06-14 13:56:40 +02:00
Pascal Seitz
be2dd41e69
add interface to create and read codecs
...
add CodecReader as common interface in fastfield codec crate
add LinearInterpolation to DynamicFastFieldReader
calc estimation and choose best codec
cleanup
2021-06-14 13:56:40 +02:00
Pascal Seitz
483fdb79cc
add linear interpolation estimation
...
add estimation tests
add codec test data in tests
2021-06-14 13:56:40 +02:00
