Zhenchi fd8fb641fd feat(parquet): introduce inverted index applier to reader (#3130) ...

* feat(parquet): introduce inverted index applier to reader

Signed-off-by: Zhenchi <zhongzc_arch@outlook.com>

* feat: purger removes index file

Signed-off-by: Zhenchi <zhongzc_arch@outlook.com>

* fix test

Signed-off-by: Zhenchi <zhongzc_arch@outlook.com>

* chore: add TODO for escape route

Signed-off-by: Zhenchi <zhongzc_arch@outlook.com>

* chore: add TODO for escape route

Signed-off-by: Zhenchi <zhongzc_arch@outlook.com>

* Update src/mito2/src/access_layer.rs

Co-authored-by: dennis zhuang <killme2008@gmail.com>

* Update src/mito2/src/sst/parquet/reader.rs

Co-authored-by: dennis zhuang <killme2008@gmail.com>

* feat: min-max index to prune row groups filtered by inverted index

Signed-off-by: Zhenchi <zhongzc_arch@outlook.com>

* feat: file_meta.inverted_index_available -> file_meta.available_indexes

Signed-off-by: Zhenchi <zhongzc_arch@outlook.com>

* chore: add TODO for leveraging WriteCache

Signed-off-by: Zhenchi <zhongzc_arch@outlook.com>

* fix fmt

Signed-off-by: Zhenchi <zhongzc_arch@outlook.com>

* fix: misset available indexes

Signed-off-by: Zhenchi <zhongzc_arch@outlook.com>

* feat: add index file size

Signed-off-by: Zhenchi <zhongzc_arch@outlook.com>

* refactor: use smallvec to reduce heap allocation

Signed-off-by: Zhenchi <zhongzc_arch@outlook.com>

* fix: add index size to disk usage

Signed-off-by: Zhenchi <zhongzc_arch@outlook.com>

---------

Signed-off-by: Zhenchi <zhongzc_arch@outlook.com>
Co-authored-by: dennis zhuang <killme2008@gmail.com>

2024-01-11 08:04:59 +00:00

..

api

fix: typos and bit operations (#2944)

2023-12-18 03:06:11 +00:00

auth

chore: multiple licenses fixes (#2714)

2023-11-09 10:38:12 +00:00

catalog

feat: adds runtime_metrics (#3127)

2024-01-10 10:51:30 +00:00

client

feat: support CSV format in sql HTTP API (#3062)

2024-01-08 10:54:27 +00:00

cmd

refactor: change how frontend grpc services are orchestrated (#3134)

2024-01-11 02:26:44 +00:00

common

refactor: change how frontend grpc services are orchestrated (#3134)

2024-01-11 02:26:44 +00:00

datanode

fix: incorrect parsing broker_endpoints env variable (#3135)

2024-01-10 13:59:49 +00:00

datatypes

feat: adds information_schema.schemata (#3051)

2023-12-29 09:22:31 +00:00

file-engine

feat: table route for metric engine (#3053)

2024-01-04 06:30:17 +00:00

frontend

refactor: change how frontend grpc services are orchestrated (#3134)

2024-01-11 02:26:44 +00:00

index

feat(parquet): introduce inverted index applier to reader (#3130)

2024-01-11 08:04:59 +00:00

log-store

chore(remote_wal): remove topic alias (#3120)

2024-01-09 07:35:02 +00:00

meta-client

feat: support CSV format in sql HTTP API (#3062)

2024-01-08 10:54:27 +00:00

meta-srv

fix: save code in debug_assert! (#3137)

2024-01-11 06:07:08 +00:00

metric-engine

refactor(metrics): add 'greptime_' prefix for every metrics (#3093)

2024-01-05 08:12:23 +00:00

mito2

feat(parquet): introduce inverted index applier to reader (#3130)

2024-01-11 08:04:59 +00:00

object-store

feat(mito): Init the write cache in datanode (#3100)

2024-01-09 04:40:22 +00:00

operator

refactor(metrics): add 'greptime_' prefix for every metrics (#3093)

2024-01-05 08:12:23 +00:00

partition

feat: metric engine support alter (#3098)

2024-01-05 09:46:39 +00:00

plugins

fix: remove StatusCode::Unexpected from masked error code set (#2654)

2023-10-26 07:57:23 +00:00

promql

feat: support PromQL function vector (#3036)

2024-01-09 03:44:00 +00:00

puffin

feat(puffin): finish return written bytes (#3082)

2024-01-03 06:55:09 +00:00

query

feat: update our cross schema check to cross catalog (#3123)

2024-01-09 09:38:48 +00:00

script

chore(python): Print Python interpreter version (#3118)

2024-01-09 07:04:23 +00:00

servers

refactor: change how frontend grpc services are orchestrated (#3134)

2024-01-11 02:26:44 +00:00

session

feat: support set timezone in db (#2992)

2023-12-27 09:19:39 +00:00

sql

fix: improve redact sql regexp (#3080)

2024-01-04 14:53:20 +00:00

store-api

test(remote_wal): add unit tests for kafka remote wal (#2993)

2024-01-08 10:48:11 +00:00

table

refactor: remove unused code for pruning row groups (#2973)

2023-12-21 07:54:29 +00:00