rust/tantivy
1
0
Fork 0
mirror of https://github.com/quickwit-oss/tantivy.git synced 2026-09-06 21:39:09 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,641 Commits 262 Branches 81 Tags
4d011cc64817472b85196b0fa99ca80f58e53e43
Commit Graph
1328 Commits
Author SHA1 Message Date
Pasha Podolsky 80cbe889ba [tantivy] Add brotli codec for row storage (#885) 
* [tantivy] Add brotli codec for row storage

* [tantivy] Fix not actual comments for code

* [CR] Fixes for comment and cursor
 2020-10-09 14:51:42 +09:00
Paul Masurel c23a03ad81 Large API Change in the Directory API. (#901) 
Tantivy used to assume that all files could be somehow memory mapped. After this change, Directory return a `FileSlice` that can be reduced and eventually read into an `OwnedBytes` object. Long and blocking io operation are still required by they do not span over the entire file.
 2020-10-08 16:36:51 +09:00
Paul Masurel 579e3d1ed8 Removed dev-deps to serde_yaml 2020-10-06 10:04:06 +09:00
Pasha PodolskyandPasha 687a36a49c [tantivy] Fix for schema deserialization error (#902) 
Co-authored-by: Pasha <pasha@izihawa.net>
 2020-10-05 11:24:48 +09:00
Paul Masurel ad82b455a3 Minor change 2020-10-01 20:45:07 +09:00
Paul Masurel 848afa43ee Merge branch 'issue/896' into main 2020-10-01 20:43:42 +09:00
Paul Masurel 7720d21265 Closes #896 - Facet reader related 
Bugfix. Acquiring a facet reader on a segment that does not contain any
doc with this facet returns `None`.
 2020-10-01 20:25:28 +09:00
Paul MasurelandRaul 96f946d4c3 Raultang master (#879) 
* add support for indexed bytes fast field

* remove backup code file

* refine test cases

* Simplified unit test. Renamed it as it is testing the storable part. Not the indexed part.

* Small refactoring and added unit test. If multivalued we only retain the first FAST value.

Co-authored-by: Raul <raul.tang.lc@gmail.com>
 2020-10-01 18:03:18 +09:00
Paul Masurel 392221e36a Removing dead file 2020-10-01 11:36:55 +09:00
Paul Masurel 674cae8ee2 Issue/822 TopDocs sorted by i64, and date fastfield (in addition to u64) (#890) 
* Unsatisfactory implementation.

The fastfield are hit. But for performance, we want the comparison to happen on u64,
and the conversion to the FastType to be done only on the selected TopK
elements.

For i64, the current approach might be ok.
For DateTime, it is most likely catastrophic.

Closes #822

* Decoupled SegmentCollector Fruit from Collector Fruit.

Deferred conversion from u64 to the proper FastField type to after the overall collection.
(tantivy guarantees that u64 encoding is consistent with the original
ordering of the fastfield)

Closes #882
 2020-09-30 17:51:11 +09:00
Paul MasurelandNicolas Polomack 838c476733 Hirevo move to thiserror (#889) 
* Migrated from `failure` to `thiserror`

* Refactoring

Co-authored-by: Nicolas Polomack <nicolas@polomack.eu>
 2020-09-30 16:34:10 +09:00
Paul Masurel 5f574348d1 Syntactic change. 2020-09-26 21:33:00 +09:00
Paul Masurel 19a02b2c30 Merge tag '0.13.1' 
0.13.1 was published as a hotfix to accomodate tantivy-py.
 2020-09-19 21:20:27 +09:00
Paul Masurel 2d3c657f9d Added Send Sync to collectors. 2020-09-19 21:04:44 +09:00
Paul Masurel 07f9b828ae Added Send and Sync to the Query trait. 2020-09-19 21:04:29 +09:00
Paul Masurel 70bae7ce4c Removing Term Vec allocation (#881) 2020-09-08 23:11:00 +09:00
Paul Masurel ac2a7273e6 Re-added comment to Score. 2020-09-08 21:41:34 +09:00
Paul Masurel 4ce9517a82 fix unit test for bench. remove scoref64 feature. fixed test for lz4 feature. 2020-09-08 07:35:00 +09:00
Paul Masurel 73024a8af3 Fixing compilation of bench and doctests. 2020-09-08 07:18:43 +09:00
Paul Masurel e70e605fc3 fix unit test (at least on linux) 2020-09-07 23:35:04 +09:00
Paul Masurel 439d6956a9 Returning Result in some of the API (#880) 
* Returning Result in some of the API

* Introducing `.writer_for_test(..)`
 2020-09-07 15:52:34 +09:00
Paul Masurel 6530bf0eae Make field types less strict when populating documents. 2020-09-06 10:24:03 +09:00
Paul Masurel 151498cbe7 Creating the tempfile for atomicwrites in the same directory as the MmapDirectory. (#878) 2020-09-05 23:06:29 +09:00
Paul Masurel 3a72b1cb98 Accept dash within field names. (#874) 
Accept dash in field names and enforce field names constraint at the
creation of the schema.

Closes #796
 2020-09-01 13:38:52 +09:00
Paul Masurel 2737822620 Fixing unit tests. (#868) 
There was a unit test failing when notify was sending more
than one event on atomicwrites.

It was observed on MacOS CI.
 2020-08-27 16:43:39 +09:00
b8591340 06c12ae221 Filter meta.json from validate_checksum (#872) 2020-08-27 07:54:37 +09:00
Paul Masurel 3f1ecf53ab Merge branch 'master' of github.com:tantivy-search/tantivy 2020-08-22 21:30:47 +09:00
Paul Masurel 0b583b8130 Plastic changes 2020-08-22 21:29:12 +09:00
Paul Masurel 31d18dca1c Removing dependency to atomicwrites (#866) 2020-08-21 21:37:05 +09:00
Paul Masurel 8af53cbd36 Merge branch 'master' of github.com:tantivy-search/tantivy 2020-08-21 08:57:42 +09:00
Paul Masurel 4914076e8f Fixing release build 2020-08-21 08:57:27 +09:00
Paul Masurel e04f47e922 Using block wand for term queries too. 2020-08-20 15:51:21 +09:00
Paul Masurel f355695581 Code clean up 2020-08-20 15:42:50 +09:00
Paul Masurel 2481c87be8 Block wand (#856) 2020-08-19 22:36:36 +09:00
Paul Masurel 9b41912e66 Bugfix (#861) 2020-08-12 16:06:24 +09:00
Paul Masurel 8e74bb98b5 Added field norm readers (#854) 2020-07-20 13:05:05 +09:00
Paul Masurel 6db8bb49d6 Assert nearly equals macro (#853) 
* Assert nearly equals macro

* Renamed specialized_scorer in TermScorer
 2020-07-17 16:40:41 +09:00
lyj 410aed0176 Update segment_updater.rs (#848) 2020-07-16 12:33:11 +09:00
aptend 00a239a712 fix typo in index_meta.rs (#851) 2020-07-16 12:32:45 +09:00
Paul Masurel 68fe406924 Removed asserts (#850) 2020-07-16 12:24:55 +09:00
Paul Masurel f71b04acb0 Bugfix. (#849) 
go_to_first_doc was typically calling seek with a target smaller than
doc.

Since SegmentPostings typically do a linear search on the full block,
regardless of the current position, it could have our segment postings
go backward.
 2020-07-16 10:57:51 +09:00
lyj 1ab7f660a4 Update index.rs (#846) 2020-07-02 15:11:38 +09:00
Sean Stangl 0ebbc4cb5a Fix incorrect SimpleTokenizer link in documentation (#844) 2020-07-01 10:26:36 +09:00
lyj 5300cb5da0 Update mod.rs (#845) 2020-07-01 10:25:26 +09:00
Ype Kingma 7d773abc92 Boolean query: do not combine excluded scores. (#840) 
* Do nothing when combining score values of excluded scores.

* Add test case for two excluded.

* Test score for two excluded terms.

* Use TopDocs in test_boolean_query_two_excluded
 2020-06-08 20:01:19 +09:00
Paul Masurel c34541ccce Alive doc iterator. (#837) 2020-06-05 19:42:51 +09:00
Paul Masurel 1cc5bd706c Fixes build for no-default-features (#839) 2020-06-05 19:41:55 +09:00
Paul Masurel 4026d183bc Small readability change 2020-06-03 09:04:57 +09:00
Paul Masurel c0f5645cd9 Move for_each functions from Scorer to Weight. (#836) 
* Move for_each functions from Scorer to Weight.

* Specialized foreach / foreach_pruning for union of termscorer.
 2020-06-01 11:31:18 +09:00
Paul Masurel cbff874e43 Change the loading of blocks. 2020-05-27 16:36:50 +09:00