Commit Graph
52 Commits
Author SHA1 Message Date
Pascal Seitz 6a9d09cf7a handle gcd like a composable codec 2022-07-28 09:54:35 +02:00
Pascal Seitz fff1a03842 replace generic with impl T 2022-07-21 14:26:45 +02:00
Pascal Seitz 7e032a9efd apply gcd on fastfield as preprocessing 2022-07-20 16:19:47 +02:00
Evance Soumaoro a4be239d38 Updated DateTime to hold timestamp in microseconds, while making date field precision configurable (#1396) 2022-07-12 10:04:28 +09:00
Pascal Seitz 02691f2445 edition 2021 for subcrates 2022-07-04 14:19:32 +08:00
dependabot[bot] fc24842a43 Update more-asserts requirement from 0.2.1 to 0.3.0 (#1384)
Updates the requirements on [more-asserts](https://github.com/thomcc/rust-more-asserts) to permit the latest version.
- [Release notes](https://github.com/thomcc/rust-more-asserts/releases)
- [Commits](https://github.com/thomcc/rust-more-asserts/compare/v0.2.2...v0.3.0)

---
updated-dependencies:
- dependency-name: more-asserts
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-06-10 10:38:28 +09:00
Paul Masurel f0a2b1cc44 Bumped tantivy and subcrate versions. 2022-05-25 22:50:33 +09:00
Paul Masurel 2e255c4bef Preparing for release 2022-03-09 09:59:08 +09:00
Antoine G a41d3d51a4 Update fastfield_codecs/src/lib.rs 2022-03-03 11:25:06 +01:00
Saroh cae34ffe47 update fastfield doc 2022-03-02 16:04:15 +01:00
Paul Masurel 9815067171 Minor changes 2022-02-21 13:55:01 +09:00
Paul Masurel 2069e3e52b Fixing clippy comments 2022-02-01 10:24:05 +09:00
Paul Masurel eca6628b3c Minor refactoring (#1266) 2022-01-28 15:55:55 +09:00
PSeitz f27ae04282 fix slope calculation in multilinear interpol (#1161)
add test to check for compression
2021-09-27 10:14:03 +09:00
Paul Masurel 9f32b22602 Preparing for release. 2021-08-26 09:07:08 +09:00
Pascal Seitz 3e8f267e33 rename common to tantivy-common 2021-08-19 10:27:20 +01:00
PSeitz ff4813529e add comments on compression (#1119) 2021-07-26 22:54:22 +09:00
Pascal Seitz 0b1add0ec6 move rand to optional dependencies
closes #1117
2021-07-21 17:49:24 +01:00
Pascal Seitz e6427b2588 cleanup 2021-07-02 09:21:22 +02:00
Pascal Seitz 9b3e508753 fix clippy 2021-07-01 18:06:09 +02:00
Pascal Seitz a1ac63ee1c fix clippy 2021-07-01 18:06:03 +02:00
Pascal Seitz 2de249af74 clippy fixes 2021-07-01 17:37:37 +02:00
Pascal Seitz 10f056fbb4 apply clippy fixes 2021-07-01 17:08:44 +02:00
Pascal Seitz 24274edf81 remove trait impl fpr &Vec 2021-06-30 09:50:47 +02:00
Pascal Seitz 6ba302c481 Use dynamic fastfield codes for multivalues fixes #1093
Use dynamic fastfield codes for multivalues fixes (only sorting case covered)
Rename get to get_val due to conflict with Vec
use u64 precision instead of u32 for get_range, to allow use of existing fast field interface interface (actually not sure if it would be better have a different interface)
2021-06-30 08:57:55 +02:00
PSeitz cd049e28bc Merge pull request #1082 from PSeitz/fastfieldcompression
use dynamic fast field codec for offset index
2021-06-16 11:59:00 +02:00
Pascal Seitz 36528c5e83 move counting writer to common
move counting writer to common
reuse counting writer in fastfield codec
2021-06-16 08:14:04 +02:00
Pascal Seitz cd169dee23 use dynamic fast field codec for offset index 2021-06-15 13:34:42 +02:00
PSeitz 268e6bfe6e update fast field codec readme 2021-06-15 09:19:39 +02:00
Pascal Seitz 77a0902605 replace unwrap, use vec in bench 2021-06-14 17:01:46 +02:00
Pascal Seitz c889ae10e4 add is_applicable to fast field codecs 2021-06-14 16:16:25 +02:00
Pascal Seitz 0a534c6ee0 rename create to serialize 2021-06-14 15:40:07 +02:00
Pascal Seitz 1071ed84f2 fix cond compilation 2021-06-14 14:05:04 +02:00
Pascal Seitz abb5624af2 add contributing guidelines, add codec comparer binary
add contributing guidelines
add codec comparer binary to test codec compressions with different test data sets
2021-06-14 13:56:40 +02:00
Pascal Seitz 1d41b96d32 rename, add codec_tester 2021-06-14 13:56:40 +02:00
Pascal Seitz ef4665945f rename file 2021-06-14 13:56:40 +02:00
Pascal Seitz 294cd5fd0b streamline traits and tests 2021-06-14 13:56:40 +02:00
Pascal Seitz f4d271177c add inline, add readme 2021-06-14 13:56:40 +02:00
Pascal Seitz e78e0fec59 add multilinearinterpolation
add multilinearinterpolation, which compresses blocks of size 512
add checks for linear interpolation
2021-06-14 13:56:40 +02:00
Pascal Seitz e296da7ade add debug and failsafes 2021-06-14 13:56:40 +02:00
Pascal Seitz 3b3e26c4b8 use f64 precision for slope calculation 2021-06-14 13:56:40 +02:00
Pascal Seitz 6a4883ac69 use uniform distribution sampling 2021-06-14 13:56:40 +02:00
Pascal Seitz 0ba05df545 add f32::MAX to disable a compressor 2021-06-14 13:56:40 +02:00
Pascal Seitz aa3c4d4029 use f32 precision, add inline 2021-06-14 13:56:40 +02:00
Pascal Seitz 60df629725 cargo.toml license desc and author 2021-06-14 13:56:40 +02:00
Pascal Seitz 2570b005ac fix estimation test 2021-06-14 13:56:40 +02:00
Pascal Seitz 2193d85622 fix clippy and common crate tests 2021-06-14 13:56:40 +02:00
Pascal Seitz dfdbfe9eff add benchmark for fast field codecs
test tests::bench_fastfield_bitpack_create        ... bench:      57,628 ns/iter (+/- 23,486)
test tests::bench_fastfield_bitpack_get           ... bench:      43,323 ns/iter (+/- 4,286)
test tests::bench_fastfield_linearinterpol_create ... bench:     223,625 ns/iter (+/- 33,563)
test tests::bench_fastfield_linearinterpol_get    ... bench:      82,839 ns/iter (+/- 9,575)
2021-06-14 13:56:40 +02:00
Pascal Seitz be2dd41e69 add interface to create and read codecs
add CodecReader as common interface in fastfield codec crate
add LinearInterpolation to DynamicFastFieldReader
calc estimation and choose best codec
cleanup
2021-06-14 13:56:40 +02:00
Pascal Seitz 483fdb79cc add linear interpolation estimation
add estimation tests
add codec test data in tests
2021-06-14 13:56:40 +02:00