rust/tantivy
1
0
Fork 0
mirror of https://github.com/quickwit-oss/tantivy.git synced 2026-09-07 22:09:03 +00:00
Code Issues Packages Projects Releases Wiki Activity
2,773 Commits 267 Branches 81 Tags
commit-changes
Commit Graph
2773 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Pascal Seitz 24274edf81 remove trait impl fpr &Vec 2021-06-30 09:50:47 +02:00
Paul Masurel d58497529b Fixed CHANGELOG to include 0.15.2. 2021-06-30 16:34:47 +09:00
Pascal Seitz 130495abab cleanup 2021-06-30 08:57:55 +02:00
Pascal Seitz 9b743d60fb make docid mapping non optional 
make docid mapping non optional
add trivial flag for docid mapping
add time measurements
 2021-06-30 08:57:55 +02:00
Pascal Seitz 5c9e2ef036 wrap docidmapping in struct 2021-06-30 08:57:55 +02:00
Pascal Seitz 8526434b63 add dynamic fastfield case 
add dynamic fastfield for single fast field unsorted
fix scary documentation bug
add num_len instead of len
 2021-06-30 08:57:55 +02:00
Pascal Seitz 6ba302c481 Use dynamic fastfield codes for multivalues fixes #1093 
Use dynamic fastfield codes for multivalues fixes (only sorting case covered)
Rename get to get_val due to conflict with Vec
use u64 precision instead of u32 for get_range, to allow use of existing fast field interface interface (actually not sure if it would be better have a different interface)
 2021-06-30 08:57:55 +02:00
Paul MasurelandAndre-Philippe Paquet de92f094aa Closes #1101 fix delete documents with sort by field 
Closes #1101

* fix delete documents with sort by field

Co-authored-by: Andre-Philippe Paquet <appaquet@gmail.com>
 2021-06-30 15:51:32 +09:00
Evance Soumaoro c82cee66de exposing min/max value interface on MultiValuedFastField Reader (#1096) 2021-06-23 17:38:50 +09:00
Paul Masurel 6eed05b1ce Revert "Exposing min/max value interface on MultiValuedFastField Reader (#1094)" (#1095) 
This reverts commit bb488305c9.
 2021-06-23 10:25:11 +09:00
Evance Soumaoro bb488305c9 Exposing min/max value interface on MultiValuedFastField Reader (#1094) 
Exposing min/max value interface on MultiValuedFastField Reader
 2021-06-23 08:51:36 +09:00
PSeitz f05e84f964 add FieldEntry constructor, closes #1086 (#1090) 2021-06-17 10:15:48 +09:00
PSeitz 65546ed22b Merge pull request #1088 from appaquet/fix/store-reader-iterator-take2 
Fix corruption in store reader iterator, take 2
 2021-06-16 14:44:00 +02:00
Andre-Philippe Paquet 57ae5b27dc fix store reader iterator, take 2 2021-06-16 07:51:39 -04:00
PSeitz f9531ec3c9 Merge pull request #1085 from PSeitz/fastfieldcompression 
use concrete return type, fixes #1084
 2021-06-16 13:07:12 +02:00
Pascal Seitz 5b54a32563 use concrete return type, fixes #1084 2021-06-16 12:03:11 +02:00
PSeitz cd049e28bc Merge pull request #1082 from PSeitz/fastfieldcompression 
use dynamic fast field codec for offset index
 2021-06-16 11:59:00 +02:00
PSeitz 646e41bec4 Merge pull request #1083 from PSeitz/termdict_block_layout 
Move counting writer to common
 2021-06-16 08:57:55 +02:00
Pascal Seitz 36528c5e83 move counting writer to common 
move counting writer to common
reuse counting writer in fastfield codec
 2021-06-16 08:14:04 +02:00
Pascal Seitz cd169dee23 use dynamic fast field codec for offset index 2021-06-15 13:34:42 +02:00
PSeitz b5cc60f80b Merge pull request #1080 from PSeitz/more_tests 
test all features in github actions
 2021-06-15 10:51:57 +02:00
Pascal Seitz 060b83159a use nightly for tests 2021-06-15 10:08:49 +02:00
Pascal Seitz a40ff35453 test all features 2021-06-15 09:31:39 +02:00
PSeitz 268e6bfe6e update fast field codec readme 2021-06-15 09:19:39 +02:00
PSeitz f902440b8b Merge pull request #1072 from PSeitz/fastfieldcompression 
Enable support for multiple fastfield codecs, add linear interpolation
 2021-06-15 09:07:17 +02:00
Pascal Seitz 77a0902605 replace unwrap, use vec in bench 2021-06-14 17:01:46 +02:00
Pascal Seitz c889ae10e4 add is_applicable to fast field codecs 2021-06-14 16:16:25 +02:00
Pascal Seitz 0a534c6ee0 rename create to serialize 2021-06-14 15:40:07 +02:00
Pascal Seitz 167d88b449 fix tests behind unstable feature flag 2021-06-14 15:31:12 +02:00
Pascal Seitz 1071ed84f2 fix cond compilation 2021-06-14 14:05:04 +02:00
Pascal Seitz abb5624af2 add contributing guidelines, add codec comparer binary 
add contributing guidelines
add codec comparer binary to test codec compressions with different test data sets
 2021-06-14 13:56:40 +02:00
Pascal Seitz 1d41b96d32 rename, add codec_tester 2021-06-14 13:56:40 +02:00
Pascal Seitz ef4665945f rename file 2021-06-14 13:56:40 +02:00
Pascal Seitz 294cd5fd0b streamline traits and tests 2021-06-14 13:56:40 +02:00
Pascal Seitz f4d271177c add inline, add readme 2021-06-14 13:56:40 +02:00
Pascal Seitz 451538fecf add serialize for bool 2021-06-14 13:56:40 +02:00
Pascal Seitz e78e0fec59 add multilinearinterpolation 
add multilinearinterpolation, which compresses blocks of size 512
add checks for linear interpolation
 2021-06-14 13:56:40 +02:00
Pascal Seitz 2e639cebf8 fix bitpacker bug, reset internal value 2021-06-14 13:56:40 +02:00
Pascal Seitz e296da7ade add debug and failsafes 2021-06-14 13:56:40 +02:00
Pascal Seitz 3b3e26c4b8 use f64 precision for slope calculation 2021-06-14 13:56:40 +02:00
Pascal Seitz 6a4883ac69 use uniform distribution sampling 2021-06-14 13:56:40 +02:00
Pascal Seitz 0ba05df545 add f32::MAX to disable a compressor 2021-06-14 13:56:40 +02:00
Pascal Seitz aa3c4d4029 use f32 precision, add inline 2021-06-14 13:56:40 +02:00
Pascal Seitz 60df629725 cargo.toml license desc and author 2021-06-14 13:56:40 +02:00
Pascal Seitz 2570b005ac fix estimation test 2021-06-14 13:56:40 +02:00
Pascal Seitz d5212cd19d fix clippy 2021-06-14 13:56:40 +02:00
Pascal Seitz 2193d85622 fix clippy and common crate tests 2021-06-14 13:56:40 +02:00
Pascal Seitz dfdbfe9eff add benchmark for fast field codecs 
test tests::bench_fastfield_bitpack_create        ... bench:      57,628 ns/iter (+/- 23,486)
test tests::bench_fastfield_bitpack_get           ... bench:      43,323 ns/iter (+/- 4,286)
test tests::bench_fastfield_linearinterpol_create ... bench:     223,625 ns/iter (+/- 33,563)
test tests::bench_fastfield_linearinterpol_get    ... bench:      82,839 ns/iter (+/- 9,575)
 2021-06-14 13:56:40 +02:00
Pascal Seitz b999e836b2 replace BitpackedFastFieldReader, delete FastFieldSerializer trait 2021-06-14 13:56:40 +02:00
Pascal Seitz be2dd41e69 add interface to create and read codecs 
add CodecReader as common interface in fastfield codec crate
add LinearInterpolation to DynamicFastFieldReader
calc estimation and choose best codec
cleanup
 2021-06-14 13:56:40 +02:00