Arthur Petukhovsky d263b1804e Fix partial upload bug with invalid remote state (#8383) ...

We have an issue that some partial uploaded segments can be actually
missing in remote storage. I found this issue when was looking at the
logs in staging, and it can be triggered by failed uploads:
1. Code tries to upload `SEG_TERM_LSN_LSN_sk5.partial`, but receives
error from S3
2. The failed attempt is saved to `segments` vec
3. After some time, the code tries to upload
`SEG_TERM_LSN_LSN_sk5.partial` again
4. This time the upload is successful and code calls `gc()` to delete
previous uploads
5. Since new object and old object share the same name, uploaded data
gets deleted from remote storage

This commit fixes the issue by patching `gc()` not to delete objects
with the same name as currently uploaded.

---------

Co-authored-by: Arpad Müller <arpad-m@users.noreply.github.com>

2024-07-18 13:46:00 +01:00

..

spec

Fix typos

2022-05-28 14:02:05 +03:00

src

Fix partial upload bug with invalid remote state (#8383)

2024-07-18 13:46:00 +01:00

tests

safekeeper: add eviction_min_resident to stop evictions thrashing (#8335)

2024-07-10 19:38:14 +01:00

Cargo.toml

Remove fs2 dependency (#8350)

2024-07-12 12:56:06 +03:00