mirror of
https://github.com/GreptimeTeam/greptimedb.git
synced 2026-01-07 22:02:56 +00:00
839e653e0d
* feat: introduce wal config and kafka config * feat: introduce kafka topic manager and selector * feat: introduce region wal options * chore: build region wal options upon starting meta srv * feat: integrate region wal options allocator into table meta allocator * chore: add wal config to metasrv.example.toml * chore: add region wal options map to create table procedure * feat: augment region create request with wal options * feat: augment DatanodeTableValue with region wal options map * chore: encode region wal options upon constructing table creator * feat: persist region wal options when creating table meta * fix: sqlness test * chore: set default wal provider to raft-engine * refactor: refactor wal options * chore: update wal options allocator * refactor: rename region wal options to wal options * chore: update usages of region wal options * chore: add some comments to kafka * chore: fill in kafka config * test: add tests for serde wal config * test: add tests for wal options * refactor: refactor wal options allocator to enum * refactor: store wal options into the request options instead * fix: typo * fix: typo * refactor: move wal options map to region info * refactor: refacto serialization and deserialization of wal options * refactor: use serde_json to encode wal options * chore: rename wal_options_map to region_wal_options * chore: resolve some review comments * fix: typo * refactor: replace kecab-case with snake_case * fix: sqlness and converage tests * fix: typo * fix: coverage test * fix: coverage test * chore: resolve some review conversations * fix: resolve some review conversations * chore: format comments in metasrv.example.toml * chore: update import style * feat: integrate wal options allocator to standalone mode * test: add compatible test for OpenRegion * test: add compatible test for UpdateRegionMetadata * chore: remove based suffix from topic selector type
Setup
To run the integration test, please copy .env.example to .env in the project root folder and change the values on need.
Take s3 for example. You need to set your S3 bucket, access key id and secret key:
# Settings for s3 test
GT_S3_BUCKET=S3 bucket
GT_S3_REGION=S3 region
GT_S3_ACCESS_KEY_ID=S3 access key id
GT_S3_ACCESS_KEY=S3 secret access key
Run
Execute the following command in the project root folder:
cargo test integration
Test s3 storage:
cargo test s3
Test oss storage:
cargo test oss
Test azblob storage:
cargo test azblob