Commit Graph

398 Commits

Author SHA1 Message Date
Paul Masurel
ca331e7fe5 Added documentation / HeapAllocable 2016-09-22 14:32:44 +09:00
Paul Masurel
994f223e35 NOBUG Simplified errors 2016-09-22 13:11:12 +09:00
Paul Masurel
de7880bde9 NOBUG Added comments. 2016-09-21 10:38:50 +09:00
Paul Masurel
025ab3c7ab NOBUG Added comments. 2016-09-21 10:27:43 +09:00
Paul Masurel
b337adbd78 NOBUG Added comments. 2016-09-21 00:52:31 +09:00
Paul Masurel
0b11ed517a NOBUG Added documents. 2016-09-20 11:07:40 +09:00
Paul Masurel
e8d5baa44b NOBUG Adding documentation 2016-09-20 08:58:43 +09:00
Paul Masurel
17715fe84c Added documentation 2016-09-20 00:43:52 +09:00
Paul Masurel
49e5114413 Edited README 2016-09-19 18:58:11 +09:00
Paul Masurel
578b8df288 NOBUG Added documentation 2016-09-19 18:45:50 +09:00
Paul Masurel
f3a24f5b3c NOBUG Code cleaning , cargo clippy 2016-09-19 17:01:37 +09:00
Paul Masurel
89cac9225b NOBUG Added unit test 2016-09-18 23:29:32 +09:00
Paul Masurel
1f274a2524 Merge branch 'master' of github.com:fulmicoton/tantivy 2016-09-18 23:16:23 +09:00
Paul Masurel
35e9beb864 Closes #24. Added info about git submodule in Readme 2016-09-18 23:15:32 +09:00
Paul Masurel
ff19426299 Removed dead code. 2016-09-15 09:23:00 +09:00
Paul Masurel
95d16d916b Removed dead code. 2016-09-15 09:15:09 +09:00
Paul Masurel
2895a1feb1 Merge remote-tracking branch 'origin/master' into bug8/experimental 2016-09-15 00:01:53 +09:00
Paul Masurel
7969fb3a71 Use logging. 2016-09-15 00:00:14 +09:00
Paul Masurel
346fc31ac2 Chaining heaps.
We commit close segments when the indexer heap is close to its capacity.
(currently we use a limit of 10_000_000).

Because we do this check before indexing a document, and before
also because serialization starts by closing the postingswriter, and
therefore all of the recorders open for the last document, we may still
overflow the heap.

We don't want to resize the heap because we may have references to objects
in the current heap.

Because of that, heap are actually chained list.
In an ideal settings, the limit should work fine and this overflow behavior should
never be activated.
2016-09-14 10:27:55 +09:00
Paul Masurel
b911c4dc98 Indexing works. 3'22 2016-09-13 00:36:42 +09:00
Paul Masurel
50687a1c7c Renaming + new unit test 2016-09-08 09:26:14 +09:00
Paul Masurel
385794419e Bigger heap in unit testwq 2016-09-07 10:04:02 +09:00
Paul Masurel
a612504e26 #8 Hashmap size as a function of the heap size 2016-09-06 22:13:55 +09:00
Paul Masurel
33aa151916 BUG-21 Remove useless 64 bits padding in fastfield.
Closes #21
2016-09-06 09:57:17 +09:00
Paul Masurel
24d2e3f6c1 switching for the stacker datastructure 2016-09-05 10:27:14 +09:00
Paul Masurel
45bb1c5ab8 Working... Test passing. Indexing wikipediua in 4min37 2016-08-30 00:52:52 +09:00
Paul Masurel
0ee2d4c612 Using the entry API to get the block list. 2016-08-29 10:18:20 +09:00
Paul Masurel
93c984c8f2 Working but dirty... 2016-08-29 09:40:35 +09:00
Paul Masurel
7f52da2c87 Unit tests passing. 2016-08-29 08:55:40 +09:00
Paul Masurel
b10227ea44 (test not passing) 2016-08-29 00:51:59 +09:00
Paul Masurel
619b65b0f3 ISSUE-8 Replacing Vec by an Unrolled Linked List. 2016-08-28 15:38:56 +09:00
Paul Masurel
a599614a94 Code clean up. 2016-08-27 17:00:14 +09:00
Paul Masurel
5e806c88ef Issue 20 Searcher pool implemented using a channel.
Operational but not really ready for merge.
2016-08-27 16:15:02 +09:00
Paul Masurel
46e2b73ea5 small refactoring 2016-08-26 10:32:49 +09:00
Paul Masurel
b2afe8592c Erased text in README 2016-08-26 10:17:09 +09:00
Paul Masurel
59150ad802 superficial refactoring 2016-08-26 09:30:09 +09:00
Paul Masurel
ce95bfd9a5 Closes #19. Move example to examples directory. 2016-08-24 10:58:08 +09:00
Paul Masurel
e6200e85af Schema now:
- internally wrapped by an Arc, cloning aggressively is ok.
- a field in schema, redundant with metas
- read-only. Needs to be built via a SchemaBuilder.
2016-08-23 22:23:47 +09:00
Paul Masurel
054405adf1 Removing the locks from the index to keep only those in Directory 2016-08-23 11:18:19 +09:00
Paul Masurel
182d2549b9 Added commit / rollback / docstamp 2016-08-21 14:38:46 +09:00
Paul Masurel
07997e67c9 Store throws an io::Error 2016-08-20 16:38:53 +09:00
Paul Masurel
2e1ad4bbce Moving code the thread code to an index_worker object 2016-08-20 16:07:32 +09:00
Paul Masurel
0639911cc3 Moved index code to another module. 2016-08-20 15:29:27 +09:00
Paul Masurel
13248a08fa Removed bug in store bench. 2016-08-20 12:04:11 +09:00
Paul Masurel
d244a198e2 Added unit tests and related bugfix.
Closes #17
2016-08-20 00:11:09 +09:00
Paul Masurel
f1d2f6b34a Moved directory errors to a submodule 2016-08-19 17:07:32 +09:00
Paul Masurel
7b5e457e1e Added delete. 2016-08-19 10:35:19 +09:00
Paul Masurel
08612899eb Change error used in directory. 2016-08-19 00:56:13 +09:00
Paul Masurel
04238d9e65 Documented the Directory behavior.
Removed sync calls, and moved then on file creation
and flush instead.
2016-08-18 23:41:58 +09:00
Paul Masurel
0972a1c6a0 Removing data copy in the RAMDirectory
The fst crate recently added support for sliced `Arc<Vec<u8>>`.
This called for a rewrite of the RAMDirectory for tantivy's RAMDirectory.
Previously every single read was copying data.

In addition:
- RAMDirectory's Write object panic if someone does not flush
right before the destruction of the object.
- In the same spirit, the postings serializer panics if someone
opens a term without closing the previous one.

Closes #16
2016-08-18 10:45:34 +09:00