rust/tantivy
1
0
Fork 0
mirror of https://github.com/quickwit-oss/tantivy.git synced 2026-09-07 13:59:12 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,680 Commits 266 Branches 81 Tags
4e93c681c0c4ac0b83fc85f4fee09bbe27fb15c8
Commit Graph
1362 Commits
Author SHA1 Message Date
Paul Masurel 4e93c681c0 Removed the SegmentCollector type from the Generics of the 
FilterCollector
 2020-11-25 14:13:22 +09:00
Paul Masurel 5a8546bb5a Revert "Move SegmentUpdater::list_files() to Index" 2020-11-25 14:01:26 +09:00
Adrien Guillo f0c1867637 Move SegmentUpdater::list_files() to Index 
... and make the method public
 2020-11-25 14:01:26 +09:00
Paul Masurel 35fbf738c9 Refactoring of the skip index. 
The skip index now identifies both the start and the end offset
of blocks. Checkpoints are compressed in blocks, reaching better
compression.
 2020-11-25 14:01:26 +09:00
Adrien Guillo 6f919c61c7 Cache store reader blocks in an LRU fashion 2020-11-25 14:01:26 +09:00
Paul Masurel 86efdb778c Marked blockwand test as ignored. 
- Using impl trait for iterating `matching_segments` in the termdict
merger
 2020-11-25 14:01:26 +09:00
Paul Masurel 960c2ee39d Fixing unit test. 2020-11-25 14:01:26 +09:00
Paul MasurelandAdrien Guillo 6653ed8eb6 Update src/core/searcher.rs 
Co-authored-by: Adrien Guillo <adrien.guillo@gmail.com>
 2020-11-25 14:01:26 +09:00
Paul Masurel e20eedd98b Make field TermMerger API public 2020-11-25 14:01:26 +09:00
Paul Masurel 90c1fdefdc Closes #930 Minor bug. 
Watch callback could be callback if the last watch handle was dropped
shortly before meta.json is called.
 2020-11-25 14:01:26 +09:00
Paul Masurel 3e27d4c211 Making block wand test more robusts 2020-11-25 14:01:26 +09:00
Adrien Guillo 4dc268482f Modified Directory::exists API to return Result<bool, OpenReadError> 2020-11-25 14:01:26 +09:00
Paul Masurel 4f20dd410e Avoid loading fieldnorms when not necessary 2020-11-25 14:01:26 +09:00
Paul Masurel b1125638f4 TermInfo contain the end_offset of the postings. 
We slice the ReadOnlySource tightly.
 2020-11-25 14:01:26 +09:00
Adrien Guillo b28be75728 Implement FileWatcher 2020-11-25 14:01:26 +09:00
barrotsteindev af7cb3ff0f simplified FilterCollector#for_segment 2020-11-23 11:09:03 +02:00
barrotsteindev 30d86c653a fmt 2020-11-22 10:40:45 +02:00
barrotsteindev 6f4c051700 updated docs 2020-11-21 21:26:44 +02:00
barrotsteindev 212e091553 removed unnecessary static liftimes 2020-11-21 21:24:27 +02:00
barrotsteindev 146058bdbf added initial implementation for filter_collector 2020-11-21 18:09:08 +02:00
Paul Masurel b2dfacdc70 Fixed bench and removed unnecessary public symbols. 2020-11-05 16:12:03 +09:00
Paul Masurel 36a0520a48 Added failing proptest and fixed it. 2020-11-05 15:40:00 +09:00
Paul Masurel 581c2bb718 Minor refactoring postings serializers options. 2020-11-03 15:47:25 +09:00
Paul Masurel 9dc36f4431 Exposing API for the hot directory 2020-10-29 13:04:13 +09:00
Paul Masurel 730ccefffb Fixes a bug in TermQuery::explain. 
Closes #915
 2020-10-28 22:29:15 +09:00
Paul Masurel 9e27da8b4e Added CR comments. 
Added Unit tests.
 2020-10-28 17:35:34 +09:00
Adrien Guillo 7f373f232a Add helper methods for BooleanQuery 2020-10-28 17:35:34 +09:00
Pasha Podolsky 71c66a5405 [tantivy] Run clippy linter (#914) 2020-10-27 14:36:02 +09:00
Paul Masurel 2eb5326aa4 Fixing compilation 2020-10-27 14:00:14 +09:00
Paul Masurel 91e92fa8a3 Made public. 2020-10-20 14:59:41 +09:00
Paul Masurel 9cc1661ce2 Updating crossbeam (#909) 2020-10-13 10:55:50 +09:00
Paul Masurel c3f44d38f3 Moving HasLen (#910) 2020-10-13 10:19:30 +09:00
Paul Masurel 01b4aa9adc Refactoring dir (#905) 2020-10-11 22:22:56 +09:00
Paul Masurel 7a78b1cba3 Fix unit test on windows 2020-10-09 14:57:39 +09:00
Pasha Podolsky 80cbe889ba [tantivy] Add brotli codec for row storage (#885) 
* [tantivy] Add brotli codec for row storage

* [tantivy] Fix not actual comments for code

* [CR] Fixes for comment and cursor
 2020-10-09 14:51:42 +09:00
Paul Masurel c23a03ad81 Large API Change in the Directory API. (#901) 
Tantivy used to assume that all files could be somehow memory mapped. After this change, Directory return a `FileSlice` that can be reduced and eventually read into an `OwnedBytes` object. Long and blocking io operation are still required by they do not span over the entire file.
 2020-10-08 16:36:51 +09:00
Paul Masurel 579e3d1ed8 Removed dev-deps to serde_yaml 2020-10-06 10:04:06 +09:00
Pasha PodolskyandPasha 687a36a49c [tantivy] Fix for schema deserialization error (#902) 
Co-authored-by: Pasha <pasha@izihawa.net>
 2020-10-05 11:24:48 +09:00
Paul Masurel ad82b455a3 Minor change 2020-10-01 20:45:07 +09:00
Paul Masurel 848afa43ee Merge branch 'issue/896' into main 2020-10-01 20:43:42 +09:00
Paul Masurel 7720d21265 Closes #896 - Facet reader related 
Bugfix. Acquiring a facet reader on a segment that does not contain any
doc with this facet returns `None`.
 2020-10-01 20:25:28 +09:00
Paul MasurelandRaul 96f946d4c3 Raultang master (#879) 
* add support for indexed bytes fast field

* remove backup code file

* refine test cases

* Simplified unit test. Renamed it as it is testing the storable part. Not the indexed part.

* Small refactoring and added unit test. If multivalued we only retain the first FAST value.

Co-authored-by: Raul <raul.tang.lc@gmail.com>
 2020-10-01 18:03:18 +09:00
Paul Masurel 392221e36a Removing dead file 2020-10-01 11:36:55 +09:00
Paul Masurel 674cae8ee2 Issue/822 TopDocs sorted by i64, and date fastfield (in addition to u64) (#890) 
* Unsatisfactory implementation.

The fastfield are hit. But for performance, we want the comparison to happen on u64,
and the conversion to the FastType to be done only on the selected TopK
elements.

For i64, the current approach might be ok.
For DateTime, it is most likely catastrophic.

Closes #822

* Decoupled SegmentCollector Fruit from Collector Fruit.

Deferred conversion from u64 to the proper FastField type to after the overall collection.
(tantivy guarantees that u64 encoding is consistent with the original
ordering of the fastfield)

Closes #882
 2020-09-30 17:51:11 +09:00
Paul MasurelandNicolas Polomack 838c476733 Hirevo move to thiserror (#889) 
* Migrated from `failure` to `thiserror`

* Refactoring

Co-authored-by: Nicolas Polomack <nicolas@polomack.eu>
 2020-09-30 16:34:10 +09:00
Paul Masurel 5f574348d1 Syntactic change. 2020-09-26 21:33:00 +09:00
Paul Masurel 19a02b2c30 Merge tag '0.13.1' 
0.13.1 was published as a hotfix to accomodate tantivy-py.
 2020-09-19 21:20:27 +09:00
Paul Masurel 2d3c657f9d Added Send Sync to collectors. 2020-09-19 21:04:44 +09:00
Paul Masurel 07f9b828ae Added Send and Sync to the Query trait. 2020-09-19 21:04:29 +09:00
Paul Masurel 70bae7ce4c Removing Term Vec allocation (#881) 2020-09-08 23:11:00 +09:00