PSeitz
28dd6b6546
collect json paths in indexing ( #2231 )
...
* collect json paths in indexing
* remove unsafe iter_mut_keys
2023-11-01 11:25:17 +01:00
PSeitz
07bf66a197
json path writer ( #2224 )
...
* refactor logic to JsonPathWriter
* use in encode_column_name
* add inlines
* move unsafe block
2023-10-24 09:45:50 +02:00
Adrien Guillo
a789ad9aee
Rename DatePrecision to DateTimePrecision ( #2051 )
2023-05-23 17:09:11 +02:00
PSeitz
7b31100208
refactor vint ( #2010 )
...
- improve performance of vint
vint serialization shows up in performance profiles during indexing.
It would also make sense to limit the value space to u29 and operate on 4 bytes only.
- remove unused code
- add missing inlines
- fix regex test
2023-04-25 08:49:36 +02:00
trinity-1686a
205e8a0a92
encode dictionary type in fst footer ( #1968 )
...
* encode additional footer for dictionary kind in fst
2023-04-12 09:43:01 +02:00
trinity-1686a
e5e50603a8
new sstable format ( #1943 )
...
* document a new sstable format
* add support for changing target block size
* use new format for sstable index
* handle sstable version errror
* use very small blocks for proptests
* add a footer structure
2023-03-21 15:03:52 +01:00
PSeitz
9e2faecf5b
add memory limit for aggregations ( #1942 )
...
* add memory limit for aggregations
introduce AggregationLimits to set memory consumption limit and bucket limits
memory limit is checked during aggregation, bucket limit is checked before returning the aggregation request.
* Apply suggestions from code review
Co-authored-by: Paul Masurel <paul@quickwit.io >
* add ByteCount with human readable format
---------
Co-authored-by: Paul Masurel <paul@quickwit.io >
2023-03-16 06:21:07 +01:00
Paul Masurel
7fae4d98d7
Adapting for quickwit2 ( #1912 )
...
* Adapting tantivy to make it possible to be plugged to quickwit.
* Apply suggestions from code review
Co-authored-by: PSeitz <PSeitz@users.noreply.github.com >
* Added unit test
---------
Co-authored-by: PSeitz <PSeitz@users.noreply.github.com >
2023-03-01 16:27:46 +09:00
Paul Masurel
7423f99719
Issue/columnar for json ( #1876 )
...
Adding support for JSON fast field.
2023-02-16 20:38:32 +09:00
trinity-1686a
539ff08a79
move DateTime to tantivy_common ( #1861 )
...
* move DateTime to tantivy_common
* resolve imports of columnar::DateTime as import of common::DateTime
2023-02-11 17:03:06 +01:00
PSeitz
45156fd869
use group_by in translate_codec_idx_to_original_id ( #1736 )
2022-12-26 06:13:29 +01:00
Paul Masurel
f39165e1e7
Moving FileSlice to tantivy-common ( #1729 )
2022-12-21 16:35:11 +09:00
Bruce Mitchener
6a88ac3fe3
Documentation improvements.
...
Fix some linking, some grammar, some typos, etc.
2022-09-18 18:05:37 +07:00
Pascal Seitz
bc85947105
add ip codec
2022-09-16 16:38:01 +08:00
Kanji Yomoda
af84e74284
Replace deprecated std package's constants on floats and integers ( #1420 )
2022-07-22 08:05:08 +09:00
Paul Masurel
eca6628b3c
Minor refactoring ( #1266 )
2022-01-28 15:55:55 +09:00
Paul Masurel
02cffa4dea
Code simplification. ( #1169 )
...
Code simplification and Clippy
2021-10-07 14:11:44 +09:00
Pascal Seitz
3265f7bec3
dissolve common module
2021-08-19 23:26:34 +01:00
Pascal Seitz
ee0881712a
move bitset to common crate, move composite file to directory
2021-08-19 17:45:09 +01:00
Pascal Seitz
36528c5e83
move counting writer to common
...
move counting writer to common
reuse counting writer in fastfield codec
2021-06-16 08:14:04 +02:00
Pascal Seitz
3298d6cb71
move common to common crate, create fastfield_codecs crate
...
move common to common crate
create fastfield_codecs crate
add bitpacker to fast field codecs
add linear interpolation to fast field codecs
add tests
2021-06-14 13:56:40 +02:00