WU Jingdi
370ec04a9d
fix: use linear interpolation to implement range LINEAR fill strategy ( #2903 )
...
* fix: use linear interpolation to implement range LINEAR fill strategy
* chore: update test case
* chore: optimize linear interpolation implementation
* chore: update test and add comment
2023-12-13 09:53:35 +00:00
LFC
c13d2fd11d
ci: correctly find the binary in dev-build when using "dev" profile ( #2925 )
2023-12-13 09:04:44 +00:00
Yue Deng
3d651522c2
feat: add build() function to return the database build info ( #2919 )
...
* feat: add build function and register it
build() function to return the database build info #2909
* refactor: fix typos and change code structure
* test: add test for build()
* refactor: cargo fmt and eliminate warnings
* Apply suggestions from code review
Co-authored-by: Weny Xu <wenymedia@gmail.com >
* refactor: move system.sql to a new directory
---------
Co-authored-by: Weny Xu <wenymedia@gmail.com >
2023-12-13 09:02:00 +00:00
Wei
fec3fcf4ef
feat: builder to vector without resetting ( #2915 )
...
* feat: finish_cloned() without resetting
* test: add unit cases
* chore: port comment
* chore: apply suggestions from code review
Co-authored-by: Yingwen <realevenyag@gmail.com >
---------
Co-authored-by: Yingwen <realevenyag@gmail.com >
2023-12-13 06:48:09 +00:00
LFC
3555e1644c
ci: able to choose cargo profile in dev-build action ( #2923 )
2023-12-13 04:14:16 +00:00
niebayes
c42168d7c2
chore: remove useless storage apis ( #2904 )
...
* chore: remove metadata.rs
* chore: remove snapshot.rs
* chore: remove chunk.rs
* chore: remove engine.rs
* chore: remove MIN_OP_TYPE from types.rs
* chore: remove region.rs
* chore: remove almost all codes in requests.rs
* chore: remove WriteRequest from requests.rs
* chore: remove responses.rs
* chore: remove unused descriptors from descriptors.rs
* chore: remove unused consts from consts.rs
* chore: remove useless comments
2023-12-13 03:36:14 +00:00
Weny Xu
3c24ca1a7a
test: add more tests for region migration procedure ( #2895 )
...
* test: add flow test for open candidate region with retryable error
* test: add flow test for upgrade candidate retry failed
* test: add flow test for upgrade candidate with retry
2023-12-13 03:00:58 +00:00
Wei
9531469660
fix: date - interval sqlness ( #2912 )
...
fix: date - interval can work
2023-12-12 12:45:38 +00:00
LFC
880ca2e786
fix: return error to client if prepare stmt param not match ( #2918 )
...
* fix: return error to client if prepare stmt param not match
* Update src/servers/src/mysql/handler.rs
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
---------
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
2023-12-12 12:41:09 +00:00
Ruihang Xia
0ce2b50676
feat!: do not get TZ info from server local env ( #2905 )
...
* feat: do not get TZ info from server local env
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add sqlness case
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add empty line
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix typo
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-12-12 12:41:05 +00:00
WU Jingdi
34635558d2
fix: support tailing commas in SQL ( #2913 )
...
* fix: support tailing commas in SQL
* fix: broken ci
2023-12-12 11:56:23 +00:00
Ruihang Xia
8a74bd36f5
style: rename *Adaptor to *Adapter ( #2914 )
...
* rename RecordBatchStreamAdaptor to RecordBatchStreamWrapper
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* rename ServerSqlQueryHandlerAdaptor to ServerSqlQueryHandlerAdapter
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-12-12 09:45:09 +00:00
Weny Xu
cf6bba09fd
refactor: use downgrading the region instead of closing region ( #2863 )
...
* refactor: use downgrading the region instead of closing region
* feat: enhance the tests for alive keeper
* feat: add a metric to track region lease expired
* chore: apply suggestions from CR
* chore: enable logging for test_distributed_handle_ddl_request
* refactor: simplify lease keeper
* feat: add metrics for lease keeper
* chore: apply suggestions from CR
* chore: apply suggestions from CR
* chore: apply suggestions from CR
* refactor: move OpeningRegionKeeper to common_meta
* feat: register operating regions to MemoryRegionKeeper
2023-12-12 09:24:17 +00:00
Ruihang Xia
89a0d3af1e
feat: set default debug level of release and dev profiles to 1 ( #2916 )
...
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-12-12 08:01:18 +00:00
tison
47e51545dd
ci: prevent running nightly FT in forks ( #2906 )
2023-12-12 02:49:52 +00:00
Zhenchi
1e22f1cb4f
feat(inverted_index.format): add writer ( #2900 )
...
* feat(inverted_index.format): add writer
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: remove clippy allow
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* Update src/index/src/inverted_index/error.rs
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
2023-12-11 09:55:25 +00:00
dennis zhuang
cf8b6c77dc
chore: clean up unused errors ( #2901 )
2023-12-11 09:08:50 +00:00
Yingwen
6a57f4975e
perf(mito): scan SSTs and memtables in parallel ( #2852 )
...
* feat: seq scan support parallelism
* feat: scan region by parallelism in config
* feat: enlarge channel size
* chore: parallel builder logs
* feat: use parallel reader accroding to source num
* chore: 128 channel size
* feat: add fetch cost metrics
* feat: add channel size to config
* feat: builder cost
* feat: logs
* feat: compiler error
* feat: fetch cost
* feat: convert cost
* chore: Revert "feat: logs"
This reverts commit 01e0df2c3a
2023-12-11 06:43:17 +00:00
tison
178018143d
ci: prevent running nightly CI in forks ( #2898 )
...
Signed-off-by: tison <wander4096@gmail.com >
2023-12-11 02:34:59 +00:00
tison
73227bbafd
chore: ignore MySQL client sent SELECT $$ ( #2896 )
...
Signed-off-by: tison <wander4096@gmail.com >
2023-12-11 02:27:22 +00:00
Weny Xu
5a99f098c5
test: add tests for region migration procedure ( #2857 )
...
* feat: add backward compatibility test for persistent ctx
* refactor: refactor State of region migration
* feat: add test utils for region migration tests
* test: add simple region migration tests
* chore: apply suggestions from CR
2023-12-08 08:47:09 +00:00
Ruihang Xia
7cf9945161
fix: re-enable ignored case test_query_prepared ( #2892 )
...
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-12-08 08:35:56 +00:00
tison
bfb4794cfa
fix: handle heartbeat shutdown gracefully ( #2886 )
...
* fix: handle heartbeat shutdown gracefully
Signed-off-by: tison <wander4096@gmail.com >
* improve logging
Signed-off-by: tison <wander4096@gmail.com >
---------
Signed-off-by: tison <wander4096@gmail.com >
2023-12-08 03:59:05 +00:00
Ruihang Xia
58183fe72f
fix: align linear_regression to PromQL's behavior ( #2879 )
...
* fix: accept f64 and i64 as predict_linear's param
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* use second instead of millisecond
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add test to linear_regression
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-12-08 02:41:10 +00:00
Niwaka
09aa4b72a5
chore: update storage config example ( #2887 )
...
chore: update config example
2023-12-07 03:18:56 +00:00
dennis zhuang
43f32f4499
feat: impl date_add/date_sub functions ( #2881 )
...
* feat: adds date_add and date_sub function
* test: add date function
* fix: adds interval to date returns wrong result
* fix: header
* fix: typo
* fix: timestamp resolution
* fix: capacity
* chore: apply suggestion
* fix: wrong behavior when adding intervals to timestamp, date and datetime
* chore: remove unused error
* test: refactor and add some tests
2023-12-07 03:02:15 +00:00
tison
ea80570cb1
fix: mysql version function result ( #2884 )
...
Signed-off-by: tison <wander4096@gmail.com >
2023-12-06 16:14:09 +00:00
Niwaka
cfe3a2c55e
feat!: support table ddl for custom storage ( #2733 )
...
* feat: support table ddl for custom_storage
* refactor: rename extract_variant_name to name
* chore: add blank
* chore: keep compatible
* feat: rename custom_stores to providers
* chore: rename
* chore: config
* refactor: add should_retry in client Error
* fix: test fail
* chore: remove unused options
* chore: remove unused import
* chore: remove the blanks.
* chore: revert
---------
Co-authored-by: dennis zhuang <killme2008@gmail.com >
2023-12-06 15:59:01 +00:00
Ruihang Xia
2cca267a32
chore: tweak status code of promql errors ( #2883 )
...
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-12-06 13:50:53 +00:00
tison
f74715ce52
refactor: RegionEngine::handle_request always returns affected rows ( #2874 )
...
* refactor: RegionEngine::handle_request -> handle_execution
Signed-off-by: tison <wander4096@gmail.com >
* propagate refactor
Signed-off-by: tison <wander4096@gmail.com >
* revert spell change
Signed-off-by: tison <wander4096@gmail.com >
* propagate refactor
Signed-off-by: tison <wander4096@gmail.com >
* cargo clippy
Signed-off-by: tison <wander4096@gmail.com >
* propagate refactor
Signed-off-by: tison <wander4096@gmail.com >
* cargo fmt
Signed-off-by: tison <wander4096@gmail.com >
* more name clarification
Signed-off-by: tison <wander4096@gmail.com >
* revert rename
Signed-off-by: tison <wander4096@gmail.com >
* wrap affected rows into RegionResponse
Signed-off-by: tison <wander4096@gmail.com >
* flatten return AffectedRows
Signed-off-by: tison <wander4096@gmail.com >
---------
Signed-off-by: tison <wander4096@gmail.com >
2023-12-06 13:27:19 +00:00
Weny Xu
1141dbe946
chore: unify the meta metrics styling ( #2875 )
...
* chore: unify the meta metrics styling
* chore: apply suggestions from CR
2023-12-06 09:20:41 +00:00
ZonaHe
a415685bf1
feat: update dashboard to v0.4.2 ( #2882 )
...
Co-authored-by: ZonaHex <ZonaHex@users.noreply.github.com >
2023-12-06 09:13:02 +00:00
dennis zhuang
f9e7762c5b
fix: add new column as primary key can't work ( #2876 )
2023-12-05 11:07:53 +00:00
Zhenchi
0b421b5177
feat(inverted_index.search): add index applier ( #2868 )
...
* feat(inverted_index.search): add fst applier
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: typos
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* feat(inverted_index.search): add fst values mapper
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: remove meta check
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: fmt & clippy
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* refactor: one expect for test
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* feat(inverted_index.search): add index applier
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* refactor: bitmap_full -> bitmap_full_range
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* feat: add check for segment_row_count
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: remove redundant code
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: reader test
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: match error in test
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: fmt
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* refactor: add helper function to construct fst value
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* refactor: polish unit tests
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* refactor: bytemuck to extract offset and size
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: toml format
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* refactor: use bytemuck
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* refactor: reorg value in unit tests
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: update proto
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: add a TODO reminder to consider optimizing the order of apply
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* refactor: InList predicates are applied first to benefit from higher selectivity
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: update proto
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* feat: add read options to control the behavior of index not found
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* refactor: polish
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* refactor: move read options to implementation instead of trait
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* feat: add SearchContext, refine doc comments
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* feat: move index_not_found_strategy as a field of SearchContext
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: rename varient
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
---------
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
2023-12-05 08:24:24 +00:00
WU Jingdi
aa89d9deef
fix: replace opendal PrometheusLayer ( #2861 )
...
* fix: replace opendal `PrometheusLayer`
* chore: add docs on `PrometheusMetricsLayer`
* chore: fix code advice
* chore: fix bug on `PrometheusMetricsLayer`
2023-12-05 07:15:45 +00:00
Weny Xu
b3ffe5cd1e
feat: handle the downgrade region instruction ( #2855 )
...
* feat: handle the downgrade region instruction
* test: add tests for RegionHeartbeatResponseHandler
* refactor: remove unused code
2023-12-05 03:30:55 +00:00
Ruihang Xia
d6ef7a75de
fix: type conversion rule reverses operands ( #2871 )
...
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-12-05 03:25:29 +00:00
LFC
6344b1e0db
fix: fragile integration tests ( #2870 )
2023-12-05 02:35:23 +00:00
tison
7d506b3c5f
feat: drop if exists ( #2859 )
...
* feat: drop if exists
Signed-off-by: tison <wander4096@gmail.com >
* sqlness cases
Signed-off-by: tison <wander4096@gmail.com >
---------
Signed-off-by: tison <wander4096@gmail.com >
2023-12-05 02:18:33 +00:00
Zhenchi
96e12e9ee5
fix: correct the previously unsuccessful decimal_ops sort result fix ( #2869 )
...
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
2023-12-04 15:29:02 +00:00
Zhenchi
a9db80ab1a
feat(inverted_index.search): add fst values mapper ( #2862 )
...
* feat(inverted_index.search): add fst applier
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: typos
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* feat(inverted_index.search): add fst values mapper
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: remove meta check
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: fmt & clippy
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* refactor: one expect for test
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* chore: match error in test
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: fmt
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* refactor: add helper function to construct fst value
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* refactor: bytemuck to extract offset and size
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: toml format
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
---------
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
2023-12-04 13:29:02 +00:00
Ruihang Xia
5f5dbe0172
fix: sort result of sqlness case decimal_ops ( #2867 )
...
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-12-04 12:34:27 +00:00
Wei
dac7a41cbd
feat: sqlness for decimal128 ( #2822 )
2023-12-04 11:22:38 +00:00
Ruihang Xia
de416465a6
feat: support time() and related functions in PromQL ( #2854 )
...
* enhance empty_metric
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* implementation
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix lhs & rhs
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix clippy
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix typo, update sqlness
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* remove deadcode
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add cast to bool modifier
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update sqlness result
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-12-04 11:21:54 +00:00
Zhenchi
58c13739f0
feat(inverted_index.search): add fst applier ( #2851 )
...
* feat(inverted_index.search): add fst applier
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: typos
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
---------
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
2023-12-04 09:21:09 +00:00
WU Jingdi
806400caff
feat: add align to / interval support in range query ( #2842 )
...
* feat: add align to / interval support in range query
* chore: fix ci
* chore: simplify `parse_duration_expr`
* chore: change s to ms
2023-12-04 08:00:41 +00:00
Weny Xu
f78dab078c
chore: correct closeable typos ( #2860 )
2023-12-04 06:25:48 +00:00
Weny Xu
7a14db68a6
feat: add upgrade candidate region step ( #2829 )
...
* feat: add upgrade candidate region step
* chore: apply suggestions from CR
* chore: apply suggestions from CR
2023-12-04 05:09:27 +00:00
Weny Xu
c26f2f94c0
chore: add logs and metrics ( #2858 )
...
* chore: add logs and metrics
* feat: add the timer to track heartbeat intervel
* feat: add the gauge to track region leases
* refactor: use gauge instead of the timer
* chore: apply suggestions from CR
* feat: add hit rate and etcd txn metrics
2023-12-04 02:51:30 +00:00
Weny Xu
781f2422b3
feat: add update metadata step for rollbacking downgraded region ( #2812 )
...
* feat: add update metadata step for rollbacking downgraded region
* feat: invalidate table cache after updating metadata
* feat: add migration abort step
2023-12-01 11:36:05 +00:00
