mirror of https://github.com/GreptimeTeam/greptimedb.git synced 2026-10-23 20:32:31 +00:00

Files

T

jeremyhi f9ab3c296b feat(log-store): skip corrupted object store WAL segments per region (#9425 )

* feat(log-store): skip corrupted object store WAL segments per region

A segment that does not decode, because its checksum does not match or
its content disagrees with its footer entry, is fetched once more. If it
still does not decode, the read follows `on_corrupted_segment`: `skip`
records a WAL hole for the region with the object key, sequence and the
footer's entry id range, increments
`greptime_logstore_object_store_wal_skipped_segments_total`, logs a
warning and continues with the next object; `fail` fails the read. A
failed fetch fails the read in both modes. Holes are kept in memory per
region and can be listed from the store.

The standalone test builder allocates WAL options through
`build_standalone_wal_provider`, and integration tests run a standalone
instance on the object store WAL across restarts, on S3 when the
`GT_S3_*` variables are set. The standalone shutdown runs every step and
returns the first error.

Signed-off-by: jeremyhi <fengjiachun@gmail.com>

* test(cmd): cover the best-effort standalone stop

Build a standalone instance whose leader services fail to stop and whose
datanode servers fail afterwards, and check that `Instance::stop` still
stops the object store WAL and returns the leader services error.

Rename `skip_segment` to `record_skipped_segment` and the file store
integration test to `test_standalone_object_store_wal_survives_restarts_on_file`.

Signed-off-by: jeremyhi <fengjiachun@gmail.com>

---------

Signed-off-by: jeremyhi <fengjiachun@gmail.com>

2026-10-08 06:33:40 +00:00

benches

perf(mito2): lazily decode dense primary key columns (#9226 )

2026-09-22 15:52:54 +00:00

src

feat(log-store): skip corrupted object store WAL segments per region (#9425 )

2026-10-08 06:33:40 +00:00

test-data

refactor: json2 v2 storage layout (#8979 )

2026-09-01 13:39:56 +00:00

AGENTS.md

feat(mito): limit approximate series index disk usage (#9313 )