Heikki Linnakangas 8e2edfcf39 Retry remote downloads. ...

Remote operations fail sometimes due to network failures or other
external reasons. Add retry logic to all the remote downloads, so that
a transient failure at pageserver startup or tenant attach doesn't
cause the whole tenant to be marked as Broken.

Like in the uploads retry logic, we print the failure to the log as a
WARNing after three retries, but keep retrying. We will retry up to 10
times now, before returning the error to the caller.

To test the retries, I created a new RemoteStorage wrapper that simulates
failures, by returning an error for the first N times that a remote
operation is performed. It can be enabled by setting a new
"test_remote_failures" option in the pageserver config file.

Fixes #3112

2022-12-20 14:27:24 +02:00

..

src

Retry remote downloads.

2022-12-20 14:27:24 +02:00

Cargo.toml

Re-introduce aws-sdk-rust as rusoto S3 replacement (#2841)

2022-11-30 17:47:32 +02:00