localhost
5d9f8a3be7
feat: add test pipeline api ( #4667 )
...
* chore: add test pipeline api
* chore: add test for test pipeline api
* chore: fix taplo check
* chore: change pipeline dryrun api path
* chore: add more info for pipeline dryrun api
2024-09-06 08:36:49 +00:00
jeremyhi
e88465840d
feat: add extension field to HeartbeatRequest ( #4688 )
...
* feat: add extension field to HeartbeatRequest
* chore: extension to extensions
* chore: upgrade proto
2024-09-06 08:29:20 +00:00
localhost
67d95d2088
refactor!: add processor builder and transform buidler ( #4571 )
...
* chore: add processor builder and transform buidler
* chore: in process
* chore: intermediate state from hashmap to vector in pipeline
* chore: remove useless code and rename some struct
* chore: fix typos
* chore: format code
* chore: add error handling and optimize code readability
* chore: fix typos
* chore: remove useless code
* chore: add some doc
* chore: fix by pr commit
* chore: remove useless code and change struct name
* chore: modify the location of the find_key_index function.
2024-09-06 07:51:08 +00:00
Yingwen
506dc20765
fix: last non null iter not init ( #4687 )
2024-09-06 04:13:23 +00:00
jeremyhi
8814695b58
feat: invalidate cache via invalidator on region migration ( #4682 )
...
feat: invalidate table via invalidator on region migration
2024-09-05 06:15:38 +00:00
Lanqing Yang
86cef648cd
feat: add more spans to mito engine ( #4643 )
...
feat: add more span on mito engine
2024-09-05 06:13:22 +00:00
Ning Sun
e476e36647
feat: add geohash and h3 as built-in functions ( #4656 )
...
* feat: add built-in functions h3 and geohash
* tests: add sqlness tests for geo functions
* doc: correct h3 comment
* fix: lint error
* fix: toml format
* refactor: address review comments
* test: add more sqlness cases
* Apply suggestions from code review
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
---------
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
2024-09-05 04:42:29 +00:00
shuiyisong
4781b327f3
fix: ref to auth err ( #4681 )
...
* fix: ref to auth err
* fix: typo
2024-09-05 04:05:39 +00:00
LFC
d43e31c7ed
feat: schedule compaction when adding sst files by editing region ( #4648 )
...
* feat: schedule compaction when adding sst files by editing region
* add minimum time interval for two successive compactions
* resolve PR comments
2024-09-04 10:10:07 +00:00
discord9
19e2a9d44b
feat: change log level dynamically ( #4653 )
...
* feat: add dyn_log handle
* feat: use reload handle
* chore: per review
2024-09-04 07:54:50 +00:00
zyy17
8453df1392
refactor: make init_global_logging() clean and add log_format ( #4657 )
...
refactor: refine the code logic of init_global_logging and add json output format
2024-09-04 03:04:51 +00:00
Ruihang Xia
8ca35a4a1a
fix: use number of partitions as parallilism in region scanner ( #4669 )
...
* fix: use number of partitions as parallilism in region scanner
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add sqlness
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: Lei HUANG <mrsatangel@gmail.com >
* order by ts
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* debug pring time range
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: Lei HUANG <mrsatangel@gmail.com >
2024-09-03 13:42:38 +00:00
Ruihang Xia
93f202694c
refactor: remove unused error variants ( #4666 )
...
* add python script
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* remove unused errors
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix all negative cases
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* setup CI
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add license header
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2024-09-03 13:19:38 +00:00
dennis zhuang
a612b67470
feat: supports name in object storage config ( #4630 )
...
* feat: supports name in object storage config
* fix: integration test
* fix: integration test
* fix: update sample config
* fix: config api test
2024-09-03 07:02:55 +00:00
jeremyhi
9b03940e03
chore: refactor metadata key value trait ( #4664 )
2024-09-03 07:00:24 +00:00
jeremyhi
8d6cd8ae16
feat: export import database ( #4654 )
...
* feat: export database create sql
* feat: import create database
* Update src/cmd/src/cli/export.rs
Co-authored-by: Weny Xu <wenymedia@gmail.com >
* Update src/cmd/src/cli/import.rs
Co-authored-by: Weny Xu <wenymedia@gmail.com >
* Update src/cmd/src/error.rs
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
* chore: make show create fail fast
---------
Co-authored-by: Weny Xu <wenymedia@gmail.com >
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
2024-09-03 04:45:25 +00:00
dennis zhuang
8f4ec536de
feat: grpc writing supports TTL hint ( #4651 )
2024-09-03 02:15:01 +00:00
Weny Xu
306bd25c64
fix: expose missing options for initializing regions ( #4660 )
...
* fix: expose `init_regions_in_background` and `init_regions_parallelism` opts
* fix: ci
2024-09-02 03:11:18 +00:00
Weny Xu
2564b5daee
fix: correct otlp endpoint formatting ( #4646 )
2024-09-02 02:59:50 +00:00
Lei, HUANG
37dcf34bb9
fix(mito): avoid caching empty batches in row group ( #4652 )
...
* fix: avoid caching empty batches in row group
* fix: clippy
* Update tests/cases/standalone/common/select/last_value.sql
* fix: sqlness
2024-09-02 02:43:00 +00:00
Yingwen
8eda36bfe3
feat: remove files from the write cache in purger ( #4655 )
...
* feat: remove files from the write cache in purger
* chore: fix typo
2024-08-31 04:19:52 +00:00
Ruihang Xia
68b59e0e5e
feat: remove the requirement that partition column must be PK ( #4647 )
...
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2024-08-31 03:16:01 +00:00
Ruihang Xia
a37aeb2814
feat: initialize partition range from ScanInput ( #4635 )
...
* feat: initialize partition range from ScanInput
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* use num_rows instead
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add todo
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* setup unordered scan
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* Update src/mito2/src/read/scan_region.rs
Co-authored-by: jeremyhi <jiachun_feng@proton.me >
* leave unordered scan unchanged
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: jeremyhi <jiachun_feng@proton.me >
2024-08-30 07:30:37 +00:00
jeremyhi
f641c562c2
feat: show create database ( #4642 )
...
* feat: show create database
* feat: add sqlness test
* chore: reorder mod and use
* feat: show create schema
* Update src/frontend/src/instance.rs
2024-08-30 03:58:11 +00:00
Lanqing Yang
9286e963e7
chore: adding heartbeat sent/recv counts in greptimedb nodes ( #4624 )
...
obs: adding heartbeat sent/recv counts in greptimedb nodes
2024-08-30 03:57:16 +00:00
LFC
8ea4f67e4b
refactor: reduce a object store "stat" call ( #4645 )
2024-08-30 03:31:19 +00:00
jeremyhi
5e4bac2633
feat: import cli tool ( #4639 )
...
* feat: import create tables
* feat: import databasse
* fix: export view schema
2024-08-29 09:32:21 +00:00
LFC
d45b04180c
feat: pre-download the ingested sst ( #4636 )
...
* refactor: pre-read the ingested sst file in object store to fill the local cache to accelerate first query
* feat: pre-download the ingested SST from remote to accelerate following reads
* resolve PR comments
* resolve PR comments
2024-08-29 08:36:41 +00:00
discord9
8c8499ce53
perf(flow): Map&Reduce Operator use batch to reduce alloc ( #4567 )
...
* feat: partial impl mfp
* feat: eval batch inner
* chore: fmt
* feat: mfp eval_batch
* WIP
* feat: Collection generic over row&Batch
* feat: render source batch
* chore: chore
* feat: render mfp batch
* feat: render reduce batch(WIP)
* feat(WIP): render reduce
* feat: reduce batch
* feat: render sink batch
* feat: render constant batch
* chore: error handling& mfp batch test
* test: mfp batch
* chore: rm import
* test: render reduce batch
* chore: add TODO
* chore: per bot review
* refactor: per review
* chore: cmt
* chore: rename
* docs: update no panic
2024-08-29 07:28:13 +00:00
Weny Xu
79f40a762b
fix: set selector_result_cache_size in unit test again ( #4641 )
2024-08-29 07:14:40 +00:00
jeremyhi
b062d8515d
feat: copy database ignores view and temporary tables ( #4640 )
...
feat: copy database ingores view and temporary tables
2024-08-29 06:17:51 +00:00
discord9
9f9c1dab60
feat(flow): use DataFusion's optimizer ( #4489 )
...
* feat: use datafusion optimization
refactor: mv `sql_to_flow_plan` elsewhere
feat(WIP): use df optimization
WIP analyzer rule
feat(WIP): avg expander
fix: transform avg expander
fix: avg expand
feat: names from substrait
fix: avg rewrite
test: update `test_avg`&`test_avg_group_by`
test: fix `test_sum`
test: fix some tests
chore: remove unused flow plan transform
feat: tumble expander
test: update tests
* chore: clippy
* fix: tumble lose `group expr`
* test: sqlness test update
* test: rm unused cast
* test: simplify sqlness
* refactor: per review
* chore: after rebase
* fix: remove a outdated test
* test: add comment
* fix: report error when not literal
* chore: update sqlness test after rebase
* refactor: per review
2024-08-29 02:52:00 +00:00
dennis zhuang
841e66c810
fix: config api and export metrics default database ( #4633 )
2024-08-28 14:28:49 +00:00
Weny Xu
47657ebbc8
feat: replay WAL entries respect index ( #4565 )
...
* feat(log_store): use new `Consumer`
* feat: add `from_peer_id`
* feat: read WAL entries respect index
* test: add test for `build_region_wal_index_iterator`
* fix: keep the handle
* fix: incorrect last index
* fix: replay last entry id may be greater than expected
* chore: remove unused code
* chore: apply suggestions from CR
* chore: rename `datanode_id` to `location_id`
* chore: rename `from_peer_id` to `location_id`
* chore: rename `from_peer_id` to `location_id`
* chore: apply suggestions from CR
2024-08-28 11:37:18 +00:00
Ruihang Xia
64ae32def0
feat: remove some redundent clone/conversion on constructing MergeScan stream ( #4632 )
...
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2024-08-28 08:52:09 +00:00
Weny Xu
744946957e
fix: set selector_result_cache_size in unit test ( #4631 )
2024-08-28 07:24:17 +00:00
Ruihang Xia
d5455db2d5
fix: update properties on updating partitions ( #4627 )
...
* fix: update properties on updating partitions
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add unit test and handle insufficient ranges
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2024-08-28 07:06:01 +00:00
Yingwen
28bf549907
fix: fallback to window size in manifest ( #4629 )
2024-08-28 06:43:56 +00:00
zyy17
eacc7bc471
refactor: add app in greptime_app_version metric ( #4626 )
...
refactor: add app in greptime_app_version metric
2024-08-27 11:19:01 +00:00
Ruihang Xia
b72d3bc71d
build(deps): bump backon to 1.0 ( #4625 )
...
* build(deps): bump backon to 1.0
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix clippy
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2024-08-27 09:38:12 +00:00
Weny Xu
3297d5f657
feat: allow skipping topic creation ( #4616 )
...
* feat: introduce `create_topics` opt
* feat: allow skipping topic creation
* chore: refine docs
* chore: apply suggestions from CR
2024-08-26 08:34:27 +00:00
Ning Sun
d6865911ee
feat: add postgres response for trasaction related statements ( #4562 )
...
* feat: add postgres fixtures WIP
* feat: implement more postgres fixtures
* feat: add compatibility for transaction/set transaction/show transaction
* fix: improve regex for set transaction
2024-08-26 08:09:21 +00:00
dennis zhuang
63f2463273
feat!: impl admin command ( #4600 )
...
* feat: impl admin statement parser
* feat: introduce AsyncFunction and implements it for admin functions
* feat: execute admin functions
* fix: license header
* fix: panic in test
* chore: fixed by code review
2024-08-26 07:53:40 +00:00
Ruihang Xia
da337a9635
perf: acclerate scatter query ( #4607 )
...
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2024-08-26 03:03:30 +00:00
fys
3973d6b01f
chore: optimize common_version build ( #4611 )
2024-08-23 12:36:28 +00:00
discord9
2c731c76ad
chore: add stats feature for jemalloc-ctl ( #4610 )
2024-08-23 11:18:30 +00:00
ozewr
40e7b58c80
feat: refactoring LruCacheLayer with list_with_metakey and concurrent_stat_in_list ( #4596 )
...
* use list_with_metakey and concurrent_stat_in_list
* change concurrent in recover_cache like before
* remove stat funcation
* use 8 concurrent
* use const value
* fmt code
* Apply suggestions from code review
---------
Co-authored-by: ozewr <l19ht@google.com >
Co-authored-by: Weny Xu <wenymedia@gmail.com >
2024-08-23 03:22:00 +00:00
zyy17
5177717f71
refactor: add fallback_to_local region option ( #4578 )
...
* refactor: add 'fallback_to_local_compaction' region option
* refactor: use 'fallback_to_local'
2024-08-23 03:09:43 +00:00
Ruihang Xia
a3b8d2fe8f
chore: bump rust toolchain to 2024-08-21 ( #4606 )
...
* chore: bump rust toolchain to 2024-08-22
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix clippy
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update workflow
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* try 20240606
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2024-08-22 15:38:10 +00:00
Weny Xu
25cd61b310
chore: upgrade toolchain to nightly-2024-08-07 ( #4549 )
...
* chore: upgrade toolchain to `nightly-2024-08-07`
* chore(ci): upgrade toolchain
* fix: fix unit test
2024-08-22 11:02:18 +00:00
