4 Commits

Author	SHA1	Message	Date
Arthur Petukhovsky	566e816298	Refactor safekeeper timelines handling (#2329) ... See https://github.com/neondatabase/neon/pull/2329 for details	2022-09-20 07:42:39 +00:00
Arseny Sher	0e1bd57c53	Add WAL offloading to s3 on safekeepers. ... Separate task is launched for each timeline and stopped when timeline doesn't need offloading. Decision who offloads is done through etcd leader election; currently there is no pre condition for participating, that's a TODO. neon_local and tests infrastructure for remote storage in safekeepers added, along with the test itself. ref #1009 Co-authored-by: Anton Shyrabokau <ahtoxa@Antons-MacBook-Pro.local>	2022-05-27 06:19:23 +04:00
Arseny Sher	6cb14b4200	Optionally remove WAL on safekeepers without s3 offloading. ... And do that on staging, until offloading is merged.	2022-05-10 22:41:02 +04:00
Arseny Sher	8b9d523f3c	Remove old WAL on safekeepers. ... Remove when it is consumed by all of 1) pageserver (remote_consistent_lsn) 2) safekeeper peers 3) s3 WAL offloading. In test s3 offloading for now is mocked by directly bumping s3_wal_lsn. ref #1403	2022-04-26 23:02:23 +04:00