rust/neon
1
0
Fork 0
mirror of https://github.com/neondatabase/neon.git synced 2026-05-22 15:41:15 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,656 Commits 1,487 Branches 282 Tags
500e8772f058ccb1a7cccbbfc83c80d14aa26a1e
Commit Graph

3 Commits

Author SHA1 Message Date
Arseny Sher
0e1bd57c53 Add WAL offloading to s3 on safekeepers. 
Separate task is launched for each timeline and stopped when timeline doesn't
need offloading. Decision who offloads is done through etcd leader election;
currently there is no pre condition for participating, that's a TODO.

neon_local and tests infrastructure for remote storage in safekeepers added,
along with the test itself.

ref #1009

Co-authored-by: Anton Shyrabokau <ahtoxa@Antons-MacBook-Pro.local>
 2022-05-27 06:19:23 +04:00
Arseny Sher
6cb14b4200 Optionally remove WAL on safekeepers without s3 offloading. 
And do that on staging, until offloading is merged.
 2022-05-10 22:41:02 +04:00
Arseny Sher
8b9d523f3c Remove old WAL on safekeepers. 
Remove when it is consumed by all of 1) pageserver (remote_consistent_lsn) 2)
safekeeper peers 3) s3 WAL offloading.

In test s3 offloading for now is mocked by directly bumping s3_wal_lsn.

ref #1403
 2022-04-26 23:02:23 +04:00