* add position_length to Token
refer #291
* Add term offset to `PhraseQuery`
ref #291
* Add new constructor for `PhraseQuery` that allows custom offset
* fix the method name as per pr comment
* Closes#291
Added unit test.
Using offsets from the analyzer in QueryParser.
* Moved NUM_SEARCHERS into a local variable
dynamically determined as the number of available cpus.
var name in lowercase (not a constant anymore).
updated it in docstring
* lowercased the varnames
* User can set number of logical cores in create_from_metas
* cargo fmt
* Num_searchers as Arc<AtomicUsize>
Retrieving the value with Relaxed ordering
Reverted create_from_metas signature. However, it calls num_cpus and
sets the Arc val
* Add skip information for posting list (skip to doc ids)
* Separate num bits from data for positions (skip n positions)
* Address in the position using a n-position offset
* Added a long skip structure to allow efficient opening of the position for a given term.
* (#321) Add support for range query parsing to grammar / parser. Still needs to be wired through the rest of the way.
* (321) Finish wiring RangeQuery parsing through
* (#321) Add logical AST query parser tests for RangeQuery
* (#321) Support parsing AllQuery
* (#321) Update documentation of QueryParser
* (#321) Support negative numbers in range query parsing
* Add TopCollector doc test
* Add CountCollector Doc Test
* Add Doc Test for MultiCollector
* Add ChainedCollector Doc Test
* Expose Fuzzy Query where it should be
* Add FuzzyTermQuery Doc Test
* Expose RegexQuery
* Regex Query Doc Test
* Add TermQuery Doc Test
* Add doc comments
* fix test 🤦
* Added explanation about the complexity variables
* Fixing unit tests
* Single threads if you check docids
* Add fst_regex crate in
* Reduce API surface area
This doesn't need to be public
* better test name
* Pull Automaton weight out so it can be shared
* Implement Regex Query
* Relocate `from_directory` closer to its usage
* Specific methods come before the generic method
* Rename open methods to follow the lead of the create methods
* Pull all creation methods next to each other
The goal here is to make it clear which methods are performing the
same function, and to assist with standardizing the API calls.
* Make `from_directory` private
This seems to be an internal function, so lets make it internal.
* Rename `create` to `create_in_dir`
This lets the name match the `create_in_ram` pattern and opens up
`create` for the generic implementation.
* Implement the generic create function
All of the create methods now delegate to the common create function
and future `create_in_*` functions now have a clear pattern
to follow as well
* Replaced lz4 by a pure rust implementation of snappy.
Closes#257
* snappy is the default compression. One can use lz4 by enabling the lz4 feature flag.
* Removed Compression trait
* Add AutomatonWeight to a fuzzy_search module
* Hacking around ownership issues
* Working through lifetime issues
* Working through tests
* fix test by lower casing the words (reducing distance)
* code review changes
* Suggestion on how to solve the borrow problem
* clean up
* Changed the heap to a paged memory arena.
* Trying to simplify the indexing term hashmap
* Exploding datastruct
* Removed some complexity in bitpacker
* rustfmt and some English grammar
* sort cargo.toml crates
* WIP: something to show
* Remove example for now
* Implement desired method
* Resolving Generic Type Arguments
* Resolve Generic Types
* Banging around on the tests
* DANGER! Change unsafe usage based on compiler warnings
* Unscrew up my rebase
* Clean Up Type Spam
Default Types FTW
* typo
* better variable names
* Remove Duplicate Levenshtein crate
* Implement StopWords Filter
- added example doctest for alphanum_only.rs so that I could
drive my own test of the stopword filter
* Style Cop
* Switch HashSet Hasher to FNV for speed
* Update Change Log
* fix missed location renaming
* Add non-deleted DocId iterator to SegmentReader
Closes#287
* Add Todo
* Add Unit Test
* Improving test based on feedback
- found bug and fixed it. :)
* Reestablish changes post rebase for clean merge