Pascal Seitz
bc85947105
add ip codec
2022-09-16 16:38:01 +08:00
Paul Masurel
64f08a1a5c
Hiding useless symbols and removing code. ( #1522 )
2022-09-16 14:42:27 +09:00
Paul Masurel
e029fdfca7
Perf fix on the MonotonicMapping column ( #1519 )
...
The Monotonic mapping was using the default implementation
for `get_range` and `.iter`.
As a result, some of the column used in merge (e.g. multivalued
fast fields) were exhibiting a very strong performance regression.
2022-09-15 14:20:43 +09:00
Paul Masurel
817225edfb
Allow for a same-thread doc compressor. ( #1510 )
...
In addition, it isolates the doc compressor logic,
better reports io::Result.
In the case of the same-thread doc compressor,
the blocks are also not copied.
2022-09-13 15:32:48 +09:00
Shikhar Bhushan
1eab12396d
Make Column: Send + Sync ( #1518 )
2022-09-13 13:31:28 +09:00
dependabot[bot]
8006f63426
Update criterion requirement from 0.3.5 to 0.4.0 ( #1517 )
...
Updates the requirements on [criterion](https://github.com/bheisler/criterion.rs ) to permit the latest version.
- [Release notes](https://github.com/bheisler/criterion.rs/releases )
- [Changelog](https://github.com/bheisler/criterion.rs/blob/master/CHANGELOG.md )
- [Commits](https://github.com/bheisler/criterion.rs/compare/0.3.5...0.4.0 )
---
updated-dependencies:
- dependency-name: criterion
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com >
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-13 10:02:12 +09:00
Adam Reichold
0a907d0319
Move pretty_assertions from dependencies to dev-dependencies to reduce dependency closure of downstream projects. ( #1515 )
2022-09-10 18:01:26 +09:00
PSeitz
45924711fd
improve docs ( #1514 )
...
fix link alias after https://github.com/rust-lang/rustfmt/pull/5262 has been merged and released.
fix dead links
2022-09-08 22:33:59 +09:00
PSeitz
14cb817a52
Merge pull request #1509 from quickwit-oss/refact-fast-field
...
refactor, fix api
2022-09-07 22:04:32 -07:00
Pascal Seitz
edd9155b88
return Write, add documentation
2022-09-08 12:41:55 +08:00
PSeitz
9497794d40
fix positions docs ( #1511 )
2022-09-08 10:24:00 +09:00
Pascal Seitz
29d56111de
refactor, fix api
...
refactor
fix clippy
fix docs
remove unused code
fix bytesfield index api flaw
2022-09-07 18:43:04 +08:00
Paul Masurel
4d634d61ff
Expose memory usage in SingleSegmentIndexWriter ( #1508 )
2022-09-07 18:33:52 +09:00
PSeitz
1f3d8ca7e2
Merge pull request #1507 from quickwit-oss/improve_test
...
add check to proptest
2022-09-07 02:30:29 -07:00
PSeitz
54696da771
Merge pull request #1505 from quickwit-oss/refact-fast-field
...
Refact fast field
2022-09-07 02:07:42 -07:00
Pascal Seitz
21c2205de9
add check to proptest
2022-09-07 16:58:07 +08:00
PSeitz
9436049d85
Merge pull request #1506 from quickwit-oss/multifastfieldbench
...
add benchmark for multivalue fast field
2022-09-07 01:36:16 -07:00
Pascal Seitz
21c9a26182
add ff creation benchmark
2022-09-07 15:43:50 +08:00
Pascal Seitz
56c68f5869
add ff creation benchmark
2022-09-07 14:03:24 +08:00
Pascal Seitz
f5e66042d8
no alloc in loop
2022-09-07 12:42:16 +08:00
Pascal Seitz
bf3327acd3
add benchmark for multivalue fast field
2022-09-06 16:55:30 +08:00
PSeitz
2a6479b66d
Merge pull request #1427 from quickwit-oss/empty_segments_crash
...
handle empty segments for merge
2022-09-05 22:59:06 -07:00
Pascal Seitz
9c2ef81198
fix clippy
2022-09-06 13:34:36 +08:00
Paul Masurel
c5d30a54bc
CR
2022-09-06 00:16:41 +09:00
Paul Masurel
c632fc014e
Refactoring fast fields codecs.
...
This removes the GCD part as a codec, and
makes it so that fastfield codecs all share
the same normalization part (shift + gcd).
2022-09-05 23:07:12 +09:00
Pascal Seitz
085e63ae43
return new segment meta
2022-09-05 15:19:01 +08:00
Pascal Seitz
f6f23ba684
optionally create segment on merge
...
create a new segment only if it contains data
fixes #1189
2022-09-05 15:07:03 +08:00
Paul Masurel
ea72cf34d6
Int based linear interpol ( #1482 )
...
* Rename BlockwiseLinear to BlockwiseLinearLegacy
Reimplements the blockwise multilinear codec using integer arithmetics.
Added comments
* add estimate for blockwise
* Added one unit test
* use int based for linear interpol
* fix merge conflicts
* reuse code
* cargo fmt
* fix clippy
* fix test
* fix off by one
fix off by one to accurately interpolate autoincrement fields
* extend test, fix estimate
* remove legacy codec
Co-authored-by: Pascal Seitz <pascal.seitz@gmail.com >
2022-09-05 15:53:00 +09:00
PSeitz
00657d9e99
Merge pull request #1504 from quickwit-oss/move-to-fastfield-codec
...
Move to fastfield codec
2022-09-03 05:18:35 -07:00
Paul Masurel
26876d41d7
Moving the serialization logic to the fastfield_codecs crate.
2022-09-03 00:29:52 +09:00
Paul Masurel
8e775b6c3d
Refactoring dyn Column ( #1502 )
2022-09-02 17:26:30 +09:00
Maxim Kraynyuchenko
e1f9af4384
Added Etsy logo to readme ( #1503 )
2022-09-02 15:27:59 +09:00
Paul Masurel
4e350c5f1b
Clippy
2022-09-02 13:05:00 +09:00
Paul Masurel
84e0c75598
Bench fixing
2022-09-02 11:15:44 +09:00
Paul Masurel
08c4412d73
Adding dragon API to build index without any thread. ( #1496 )
...
Closes #1487
2022-09-01 10:32:36 +09:00
Shikhar Bhushan
70e58adff9
OwnedBytes doc clarification (#1498 )
...
It only exposes it with the same lifetime as `&self`, which is what keeps things safe
2022-09-01 10:32:17 +09:00
PSeitz
0d1cd119e9
Merge pull request #1497 from quickwit-oss/improve_proptest
...
custom num strategy, faster test
2022-08-31 06:25:25 -07:00
Pascal Seitz
d3dd620048
fix clippy
2022-08-31 13:13:56 +02:00
Pascal Seitz
e89c220b56
custom num strategy, faster test
...
closes #1486
faster test with rand values
2022-08-31 12:08:44 +02:00
Paul Masurel
a451f6d60d
Minor refactoring. ( #1495 )
2022-08-31 12:00:58 +09:00
PSeitz
f740ddeee3
Merge pull request #1493 from quickwit-oss/remove_vec_impl
...
remove Column impl on Vec
2022-08-29 07:54:33 -07:00
Pascal Seitz
7a26cc9022
add VecColumn
2022-08-29 15:49:43 +02:00
Pascal Seitz
54972caa7c
remove Column impl on Vec
...
remove Column impl on Vec to avoid function shadowing
2022-08-29 11:57:41 +02:00
PSeitz
5d436759b0
Merge pull request #1480 from quickwit-oss/overflow_issue
...
fix overflow issue in interpolation
2022-08-28 16:44:00 -07:00
PSeitz
6f563b1606
Merge pull request #1491 from quickwit-oss/col-trait-refact
...
Introducing a column trait
2022-08-28 10:05:25 -07:00
Pascal Seitz
095fb68fda
fix doc test
2022-08-28 18:30:39 +02:00
Pascal Seitz
6316eaefc6
fix benches
2022-08-28 14:38:30 +02:00
Paul Masurel
5331be800b
Introducing a column trait
2022-08-28 14:14:27 +02:00
Paul Masurel
c73b425bc1
Fixing unit tests
2022-08-27 23:20:57 +02:00
Paul Masurel
54cfd0d154
Removing Deserializer trait ( #1489 )
...
Removing Deserializer trait and renaming the `Serializer` trait `FastFieldCodec`.
Small refactoring estimate.
2022-08-28 04:54:55 +09:00