tison
417be13400
feat: adopt human-panic crash reports ( #2996 )
...
* feat: adopt human-panic crash reports
Signed-off-by: tison <wander4096@gmail.com >
* build: fix dep toml conflict
Signed-off-by: tison <wander4096@gmail.com >
---------
Signed-off-by: tison <wander4096@gmail.com >
2023-12-25 13:23:18 +00:00
Ruihang Xia
0a9ad004a4
chore: bump version to 0.5.0 ( #3000 )
...
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-12-25 13:14:59 +00:00
niebayes
7d509e97f6
chore: move some commonly referenced crates to workspace Cargo.toml ( #2981 )
...
fix: resolve conflicts
2023-12-22 09:13:18 +00:00
Weny Xu
d2f49cbc2e
chore: remove debug = 1 of dev profile ( #2966 )
2023-12-20 04:37:46 +00:00
Zhenchi
029ff2f1e3
feat(inverted_index.create): add read/write for external intermediate files ( #2942 )
...
* feat(inverted_index.create): add read/write for external intermediate files
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: MAGIC_CODEC_V1 -> CODEC_V1_MAGIC
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: polish comments
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: fix typos intermedia -> intermediate
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: typos
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: futures_code -> asynchronous_codec
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: bump bytes to 1.5
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
---------
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
2023-12-18 09:44:48 +00:00
Ruihang Xia
9af9c0229a
feat: create table procedure for metric engine, part 1 ( #2943 )
...
* implementation
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* initialize
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* remove empty file
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* apply review sugg
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-12-18 08:03:28 +00:00
Wei
5dc7ce1791
fix: typos and bit operations ( #2944 )
...
* fix: typos and bit operation
* fix: helper
* chore: add tests in decimal128.rs and interval.rs
* chore: test
* chore: change proto version
* chore: clippy
2023-12-18 03:06:11 +00:00
Ruihang Xia
89a0d3af1e
feat: set default debug level of release and dev profiles to 1 ( #2916 )
...
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-12-12 08:01:18 +00:00
Yingwen
6a57f4975e
perf(mito): scan SSTs and memtables in parallel ( #2852 )
...
* feat: seq scan support parallelism
* feat: scan region by parallelism in config
* feat: enlarge channel size
* chore: parallel builder logs
* feat: use parallel reader accroding to source num
* chore: 128 channel size
* feat: add fetch cost metrics
* feat: add channel size to config
* feat: builder cost
* feat: logs
* feat: compiler error
* feat: fetch cost
* feat: convert cost
* chore: Revert "feat: logs"
This reverts commit 01e0df2c3a
2023-12-11 06:43:17 +00:00
Zhenchi
0b421b5177
feat(inverted_index.search): add index applier ( #2868 )
...
* feat(inverted_index.search): add fst applier
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: typos
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* feat(inverted_index.search): add fst values mapper
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: remove meta check
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: fmt & clippy
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* refactor: one expect for test
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* feat(inverted_index.search): add index applier
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* refactor: bitmap_full -> bitmap_full_range
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* feat: add check for segment_row_count
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: remove redundant code
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: reader test
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: match error in test
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: fmt
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* refactor: add helper function to construct fst value
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* refactor: polish unit tests
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* refactor: bytemuck to extract offset and size
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: toml format
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* refactor: use bytemuck
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* refactor: reorg value in unit tests
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: update proto
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: add a TODO reminder to consider optimizing the order of apply
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* refactor: InList predicates are applied first to benefit from higher selectivity
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: update proto
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* feat: add read options to control the behavior of index not found
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* refactor: polish
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* refactor: move read options to implementation instead of trait
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* feat: add SearchContext, refine doc comments
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* feat: move index_not_found_strategy as a field of SearchContext
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: rename varient
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
---------
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
2023-12-05 08:24:24 +00:00
tison
7d506b3c5f
feat: drop if exists ( #2859 )
...
* feat: drop if exists
Signed-off-by: tison <wander4096@gmail.com >
* sqlness cases
Signed-off-by: tison <wander4096@gmail.com >
---------
Signed-off-by: tison <wander4096@gmail.com >
2023-12-05 02:18:33 +00:00
Zhenchi
a9db80ab1a
feat(inverted_index.search): add fst values mapper ( #2862 )
...
* feat(inverted_index.search): add fst applier
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: typos
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* feat(inverted_index.search): add fst values mapper
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: remove meta check
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: fmt & clippy
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* refactor: one expect for test
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: match error in test
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: fmt
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* refactor: add helper function to construct fst value
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* refactor: bytemuck to extract offset and size
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: toml format
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
---------
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
2023-12-04 13:29:02 +00:00
Zhenchi
58c13739f0
feat(inverted_index.search): add fst applier ( #2851 )
...
* feat(inverted_index.search): add fst applier
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: typos
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
---------
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
2023-12-04 09:21:09 +00:00
WU Jingdi
806400caff
feat: add align to / interval support in range query ( #2842 )
...
* feat: add align to / interval support in range query
* chore: fix ci
* chore: simplify `parse_duration_expr`
* chore: change s to ms
2023-12-04 08:00:41 +00:00
Weny Xu
616eb04914
chore: bump version to 0.4.4 ( #2840 )
...
chore: bump to v0.4.4
2023-11-29 08:59:42 +00:00
Zhenchi
b3edbef1f3
feat(inverted_index): add index reader ( #2803 )
...
* feat(inverted_index): add reader
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: toml format
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: add prefix relative_ to the offset parameter
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* docs: add doc comment
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: update proto
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: outdated docs
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
---------
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
2023-11-27 03:31:44 +00:00
Wei
3a4c9f2b45
feat: supports decimal type in RPC ( #2788 )
...
* refactor: ColumnDataTypeWrapper
* feat: decimal128 grpc
* feat: add test case
* chore: add TODO
* chore: empty line
* chore: remove precision and scale
* refactor: remove precision and scale
* chore: remove sqlness test
* chore: rename
* chore: proto version
* chore: cr comment.
Co-authored-by: Yingwen <realevenyag@gmail.com >
* Update src/mito2/src/memtable/time_series.rs
Co-authored-by: Yingwen <realevenyag@gmail.com >
---------
Co-authored-by: Yingwen <realevenyag@gmail.com >
2023-11-24 09:19:33 +00:00
Yingwen
b9146c88ff
refactor: Remove usages of the old storage crate ( #2777 )
...
* chore: remove storage from some crate
* feat: remove storage config
* feat: remove storage from cmd
* feat: impl stream_to_parquet
* feat: remove storage from operator
* feat: remove stream writer from mito2
* feat: remove storage from project toml
* test: fix config api test
* docs: remove outdated configs
* refactor: remove storage directory
2023-11-20 20:29:41 +08:00
Zhenchi
d9eeeee06e
feat(puffin): add file reader ( #2751 )
...
* feat(puffin): add file reader
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: toml format
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: rename PuffinParser to PuffinFileReader
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: polish comments
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* Update src/puffin/src/file_format/reader/footer.rs
Co-authored-by: Yingwen <realevenyag@gmail.com >
* Update src/puffin/src/file_format/reader/file.rs
Co-authored-by: Yingwen <realevenyag@gmail.com >
* Update src/puffin/src/file_format/reader/footer.rs
Co-authored-by: Yingwen <realevenyag@gmail.com >
* Update src/puffin/src/file_format/reader/footer.rs
Co-authored-by: Yingwen <realevenyag@gmail.com >
* fix: check file size
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: redundant type cast
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: reuse read buffer
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: check payload size
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: check payload size
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: validate blob offset
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: validate blob offset
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
---------
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
Co-authored-by: Yingwen <realevenyag@gmail.com >
2023-11-20 04:29:41 +00:00
WU Jingdi
500e299e40
feat: Enable distributed tracing in greptimedb ( #2755 )
...
* feat: implement distributed tracing
* fix: change usage of span
* fix: use otlp as exporter
* chore: update dependence
* chore: add span info
* chore: add alias
* chore: use instrument instead of trace
2023-11-17 08:51:57 +00:00
Ruihang Xia
ac4b6cd7f0
feat: write logical region to metric engine ( #2759 )
...
* transform write request
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add tests for put request
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* use table_id instead of metric_name
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix typo
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* CR sugg.
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* define random state as const
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-11-17 07:44:11 +00:00
Lei, HUANG
e083b8011c
chore: bump greptimedb version v0.4.3 ( #2766 )
2023-11-17 06:12:37 +00:00
Wei
ae27fbc7f2
feat: impl Vector, DataType traits for decimal128 ( #2727 )
...
* feat: decimal128 vector
* feat: Decimal128Type in datatypes
* refactor: cast function
* feat: decimal128 type in ConcreteDataType
* chore: decimal
* chore: sql_data_type_to_concrete_data_type
* chore: cr comment
Co-authored-by: Dennis Zhuang <killme2008@gmail.com >
Co-authored-by: Yingwen <realevenyag@gmail.com >
* chore: fix finish()
* chore: add debug_assert to new decimal128
---------
Co-authored-by: Dennis Zhuang <killme2008@gmail.com >
Co-authored-by: Yingwen <realevenyag@gmail.com >
2023-11-16 06:44:26 +00:00
Zhenchi
3329da5b72
feat(puffin): add partial reader ( #2741 )
...
* feat(puffin): add partial reader
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* address comment
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
---------
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
2023-11-15 06:28:20 +00:00
LFC
3dffc7b62c
fix: upgrade dependency to resolve github security alert ( #2744 )
2023-11-14 09:11:43 +00:00
Zhenchi
1757061272
feat: introduce metadata struct of puffin ( #2725 )
...
* feat: introduce metadata struct of puffin
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: fmt
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: address suggestions
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
---------
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
2023-11-13 10:02:40 +00:00
Weny Xu
a3611516a2
refactor: heartbeat response contains region role ( #2718 )
2023-11-09 09:24:36 +00:00
Ruihang Xia
93f21b188d
chore: unify workspace dependencies and remove some unused ( #2713 )
...
* log-store
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* base64
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* udeps
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* snafu
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* snafu style
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* change the workspace deps' style
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-11-09 07:34:22 +00:00
Wei
0a91335e24
feat: decimal128 type in common ( #2696 )
...
* feat: decimal type in common
* chore: rename
* feat: decimal128 compare
* chore: clippy
* chore: typos
* chore: cr comment
Co-authored-by: Dennis Zhuang <killme2008@gmail.com >
* chore: cr comment.
Co-authored-by: Zhenchi <zhongzc_arch@outlook.com >
---------
Co-authored-by: Dennis Zhuang <killme2008@gmail.com >
Co-authored-by: Zhenchi <zhongzc_arch@outlook.com >
2023-11-06 08:04:50 +00:00
WU Jingdi
bbaae9223a
feat: enable empty range by ( #2697 )
2023-11-06 03:45:33 +00:00
Weny Xu
060864d0c1
feat: decrease the page size if the response size exceeds the limit ( #2689 )
...
* feat: decrease the `page size` if the response message size exceeds the limit
* chore: apply suggestions from CR
* feat: prefer to use adaptive_page_size
* chore: apply suggestions from CR
2023-11-06 03:36:15 +00:00
Ruihang Xia
0dca63bc7b
feat: Metric engine skeleton ( #2687 )
...
* metadata region logic
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix mito2 test feature gate
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* override unused warnings
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add basic test
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* apply review sugg
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix clippy lints
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-11-03 08:34:08 +00:00
zyy17
7bd137f398
chore: update greptime-proto to main ( #2672 )
2023-11-01 03:13:36 +00:00
WU Jingdi
180bc64cb0
feat: change metric crate from metrics to prometheus ( #2655 )
...
* feat: change metrics to prometheus
* chore: fix code advise
* chore: resolve merge conflict
* chore: fix code advise
2023-10-31 15:46:57 +00:00
Weny Xu
54ed7529ca
feat: introduce the region role ( #2640 )
...
* feat: introduce region role
* chore: apply suggestions from CR
2023-10-31 06:59:22 +00:00
Weny Xu
88eb69530a
refactor: remove router rpc ( #2646 )
2023-10-31 04:54:56 +00:00
Weny Xu
bd177b8cc4
refactor: remove move_value ( #2661 )
...
* chore: bump orc-rust to 0.2.42
* refactor: remove move_value
2023-10-27 03:42:50 +00:00
Ruihang Xia
5d8b0e8154
chore: bump dependencies ( #2659 )
...
* fix all hard error
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix nextest
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* trivial changes
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix order by
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix sql keyword and data type
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix range exec's input partitioning
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix cover input type
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix explain analyze
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update distributed mode sqlness result
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix lints
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update locks
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* downgrade dlv-list
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-10-26 12:24:14 +00:00
liyang
01fdbf3626
chore: upgrade 0.4.2 ( #2644 )
2023-10-24 12:21:58 +08:00
yuanbohan
44280f7c9d
feat(otlp): initial OTLP trace support ( #2627 )
...
* feat: otlp tracing framework via http
* feat: otlp trace transformer plugin
* feat: successfully write traces into db
* chore: plugin to parse request
* test: helper functions
* feat: parse_request_to_spans function
* chore: remove implicite calling parse in PraceParser
* chore: fix clippy
* chore: add TODO marker for span fields
* refactor TraceParser trait
* refactor TraceParser trait
* table_name method in OTLP TraceParser trait
* fix: approximate row, column count
* chore: function signature without row
* chore: do not clone by moving span.kind upper
* docs for parse and to_grpc_insert_requests
---------
Co-authored-by: fys <fengys1996@gmail.com >
Co-authored-by: fys <40801205+fengys1996@users.noreply.github.com >
2023-10-23 06:37:43 +00:00
WU Jingdi
46e106bcc3
feat: allow nest range expr in Range Query ( #2557 )
...
* feat: eable range expr nest
* fix: change range expr rewrite format
* chore: organize range query tests
* chore: change range expr name(e.g. MAX(v) RANGE 5s FILL 6)
* chore: add range query test
* chore: fix code advice
* chore: fix ca
2023-10-18 07:03:26 +00:00
zyy17
3217b56cc1
ci: release new version '0.4.0' -> '0.4.1' ( #2611 )
2023-10-17 07:33:41 +00:00
Yingwen
0a394c73a2
chore: bump version to 0.4.0 ( #2563 )
2023-10-10 16:16:15 +08:00
shuiyisong
007f7ba03c
refactor: extract plugins crate ( #2487 )
...
* chore: move frontend plugins fn
* chore: move datanode plugins to fn
* chore: add opt plugins
* chore: add plugins to meta-srv
* chore: setup meta plugins, wait for router extension
* chore: try use configurator for grpc too
* chore: minor fix fmt
* chore: minor fix fmt
* chore: add start meta_srv for hook
* chore: merge develop
* chore: minor fix
* chore: replace Arc<Plugins> with PluginsRef
* chore: fix header
* chore: remove empty file
* chore: modify comments
* chore: remove PluginsRef type alias
* chore: remove `OptPlugins`
2023-10-09 04:54:27 +00:00
Ruihang Xia
d5e4fcaaff
feat: dist plan optimize part 2 ( #2543 )
...
* allow udf and scalar fn
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* put CountWildcardRule before dist planner
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* bump datafusion to fix first_value/last_value
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update sqlness result
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* use retain instead
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-10-09 02:18:36 +00:00
shuiyisong
067917845f
fix: carry dbname from frontend to datanode ( #2520 )
...
* chore: add dbname in region request header for tracking purpose
* chore: fix handle read
* chore: add write meter
* chore: add meter-core to dep
* chore: add converter between RegionRequestHeader and QueryContext & update proto version
2023-10-08 06:30:23 +00:00
dennis zhuang
ff15bc41d6
feat: improve object storage cache ( #2522 )
...
* feat: refactor object storage cache with moka
* chore: minor fixes
* fix: concurrent issues and invalidate cache after write/delete
* chore: minor changes
* fix: cargo lock
* refactor: rename
* chore: change DEFAULT_OBJECT_STORE_CACHE_SIZE to 256Mib
* fix: typo
* chore: style
* fix: toml format
* chore: toml
* fix: toml format
* Update src/object-store/src/layers/lru_cache/read_cache.rs
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
* chore: update Cargo.toml
Co-authored-by: Yingwen <realevenyag@gmail.com >
* chore: update src/object-store/Cargo.toml
Co-authored-by: Yingwen <realevenyag@gmail.com >
* chore: refactor and apply suggestions
* fix: typo
* feat: adds back allow list for caching
* chore: cr suggestion
Co-authored-by: Yingwen <realevenyag@gmail.com >
* chore: cr suggestion
Co-authored-by: Yingwen <realevenyag@gmail.com >
* refactor: wrap inner Accessor with Arc
* chore: remove run_pending_task in read and write path
* chore: the arc is unnecessary
---------
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: Yingwen <realevenyag@gmail.com >
2023-10-08 03:27:49 +00:00
Yingwen
a6116bb866
feat(mito): Add cache manager ( #2488 )
...
* feat: add cache manager
* feat: add cache to reader builder
* feat: add AsyncFileReaderCache
* feat: Impl AsyncFileReaderCache
* chore: move moka dep to workspace
* feat: add moka cache to the manager
* feat: implement parquet meta cache
* test: test cache manager
* feat: consider vec size
* style: fix clippy
* test: fix config api test
* feat: divide cache
* test: test disabling meta cache
* test: fix config api test
* feat: remove meta cache if file is purged
2023-09-26 11:46:19 +00:00
Vanish
7fc9604735
feat: distribute truncate table in region server ( #2414 )
...
* feat: distribute truncate table
* chore: add metrics for truncate table
* test: add sqlness test
* chore: cr
* test: add multi truncate
* chore: add trace id to the header
2023-09-26 11:14:14 +00:00
Yingwen
c9f8b9c7c3
feat: update proto and remove create_if_not_exists ( #2467 )
2023-09-22 03:24:49 +00:00
