0be7ed0cb5
decrease log message severity for timeline checkpoint internals
2022-03-23 18:20:43 +04:00
e80ae4306a
change log level from info to debug for timeline gc messages
2022-03-23 18:20:43 +04:00
123fcd5d0d
Revert accidental bump of vendor/postgres submodule
...
I accidentally bumped it in commit 3b069f5aef
2022-03-23 15:45:29 +02:00
15434ba7e0
Show cachepot build stats
2022-03-23 14:12:59 +02:00
a4d0d78e9e
s3 settings for pageserver ( #1388 )
2022-03-23 13:39:55 +03:00
e13bdd77fe
add safekepeers gossip annd storage messaging rfcs
...
they were in prs during rfc repo import
in addition to just import I've added sequence diagrams to storage
messaging rfc
2022-03-22 15:01:26 +04:00
bd6bef468c
Provide single list timelines HTTP API handle
2022-03-21 13:42:21 +02:00
77ed2a0fa0
Run GitHub testing workflow on every push
2022-03-21 12:46:33 +02:00
37ebbb598d
Add a macOs build
2022-03-21 12:46:33 +02:00
063f9ba81d
Use serde_with to (de)serialize ZId and Lsn to hex
2022-03-21 12:46:07 +02:00
3b069f5aef
Fix name of directory used in unit test.
...
There's another test called 'timeline_load'. If the two tests run in
parallel, they would conflict and fail.
2022-03-18 21:27:48 +02:00
b19870cd88
guard against partial uploads to local storage
2022-03-18 18:14:57 +03:00
7738254f83
refactor timeline memory state management
2022-03-18 18:14:57 +03:00
a7544eead5
Remove the last non-borrowed string from BeMessage ( #1376 )
2022-03-17 16:46:58 +03:00
ab124c161b
Merge branch 'release' into main
2022-03-17 00:05:51 +03:00
1fddb0556f
deploy playbook fix - interaction with console ( #1374 )
2022-03-17 00:01:17 +03:00
15a2a2bf04
release 2202-03-16 ( #1373 )
...
production deploy
2022-03-16 23:00:01 +03:00
705f51db27
[proxy] Propagate some errors to user ( #1329 )
...
* [proxy] Propagate most errors to user
This change enables propagation of most errors to the user
(e.g. auth and connectivity errors). Some of them will be
stripped of sensitive information.
As a side effect, most occurrences of `anyhow::Error` were
replaced with concrete error types.
* [proxy] Box weighty errors
2022-03-16 21:20:04 +03:00
9c1a9a1d9f
Update Cargo.lock for new dependencies ( #1354 )
...
Commit b2ad8342d2
2022-03-14 21:06:25 +03:00
d5a96d3d50
Fix finding end of WAL on safekeepers after f86cf93435.
...
That commit dropped wal_start_lsn, now we're looking since commit_lsn, which is
the real end of WAL if no records follow it.
ref #1351
2022-03-14 18:54:59 +03:00
d93fc371f3
Import all existing RFCs documents from the separate 'rfcs' repository.
2022-03-11 18:49:36 +02:00
5d7bd8643a
Fix page reconstruct time histo
...
Signed-off-by: Dhammika Pathirana <dhammika@gmail.com >
2022-03-10 14:42:28 -08:00
a8a7dc9ca6
Fix zid encoding
...
Signed-off-by: Dhammika Pathirana <dhammika@gmail.com >
2022-03-10 14:42:28 -08:00
b2ad8342d2
Add zid stringify bench test
...
Signed-off-by: Dhammika Pathirana <dhammika@gmail.com >
2022-03-10 14:42:28 -08:00
27dadba52c
Fix retain references to layer histograms
...
Signed-off-by: Dhammika Pathirana <dhammika@gmail.com >
2022-03-10 14:42:28 -08:00
f67d010d1b
Add ps smgr/storage metrics tenant tags
...
Signed-off-by: Dhammika Pathirana <dhammika@gmail.com >
Add tenant_id,timeline_id in smgr/storage metrics (#1234 )
2022-03-10 14:42:28 -08:00
093ad8ab59
Send 409 HTTP responses on timeline and tenant creation for existing entity
2022-03-10 19:38:58 +02:00
c51d545fd9
Serialize Lsn as strings in http api
2022-03-10 19:38:58 +02:00
fe6fccfdae
Allow already existing repo when creating a tenant
2022-03-10 19:38:58 +02:00
dd74c66ef0
Do not create timeline along with tenant
2022-03-10 19:38:58 +02:00
a5e10c4f64
Tidy up pageserver's endpoints
2022-03-10 19:38:58 +02:00
7b5482bac0
Properly store the branch name mappings
2022-03-10 19:38:58 +02:00
c7569dce47
Allow passing initial timeline id into zenith CLI commands
2022-03-10 19:38:58 +02:00
4d0f7fd1e4
Update Zenith CLI config between runs
2022-03-10 19:38:58 +02:00
f49990ed43
Allow creating timelines by branching off ancestors
2022-03-10 19:38:58 +02:00
0c91091c63
Avoid point in time concept on pageserver level
2022-03-10 19:38:58 +02:00
10f811e886
Use timeline instead of branch in pageserver's API
2022-03-10 19:38:58 +02:00
2883a25761
Bump vendor/postgres to use local relation cache for smgr_exists
2022-03-10 17:36:09 +04:00
87f306c516
Tune backpressure in python tests to make them more stable
2022-03-10 17:36:09 +04:00
5b34afe893
Bump vendor/postgres to use local relation cache for smgr_exists
2022-03-10 17:36:09 +04:00
15b19a0a57
[proxy] Test connstr options ( #1344 )
...
* Add proxy test
* Fix typo
2022-03-09 22:47:06 +03:00
934bbcba0f
revert docker build to debian:buster based rust ( #1347 )
...
* dockerfile fix, rust cache in docker build flow
* check rust cachepot
* another check rust cachepot
* cleanup
* revert docker build to debian:buster based rust to avoid libc6 version mismatch
2022-03-09 10:13:46 +03:00
cffac59a41
Docker improvement ( #1345 )
...
* dockerfile fix, rust cache in docker build flow
* check rust cachepot
* another check rust cachepot
* cleanup
2022-03-08 23:19:49 +03:00
8e37d345a8
Adjust safekeeper detailed logging to batch fsyncing.
2022-03-08 08:07:00 +03:00
f86cf93435
Refactor timeline creation on safekeepers, allowing storing peer ids.
...
Have separate routine and http endpoint to create timeline on safekeepers. It is
not used yet, i.e. timeline is still created implicitly, but we'll change that
once infrastructure for learning which tlis are assigned to which safekeepers
will be ready, preventing accidental creation by compute.
Changes format of safekeeper control file, allowing to store set of
peers. Knowing peers provides a part of foundation for peer
recovery (calculating min horizons like truncate_lsn for WAL truncation and
commit_lsn for sync-safekeepers replacement) and proper membership change;
similarly, we don't yet use it for now.
Employing cf file version bump, extracts tenant_id and timeline_id to top level
where it is more suitable. Also adds a bunch of LSNs there and rename
truncate_lsn to more specific peer_horizon_lsn.
2022-03-06 08:06:38 +03:00
66eb2a1dd3
Replace zenith/build build image with zimg/* ones
2022-03-04 13:46:44 +02:00
9424bfae22
Use a separate newtype for ZId that (de)serialize as hex strings
2022-03-04 10:58:40 +02:00
1d90b1b205
add node id to pageserver ( #1310 )
...
* Add --id argument to safekeeper setting its unique u64 id.
In preparation for storage node messaging. IDs are supposed to be monotonically
assigned by the console. In tests it is issued by ZenithEnv; at the zenith cli
level and fixtures, string name is completely replaced by integer id. Example
TOML configs are adjusted accordingly.
Sequential ids are chosen over Zid mainly because they are compact and easy to
type/remember.
* add node id to pageserver
This adds node id parameter to pageserver configuration. Also I use a
simple builder to construct pageserver config struct to avoid setting
node id to some temporary invalid value. Some of the changes in test
fixtures are needed to split init and start operations for envrionment.
Co-authored-by: Arseny Sher <sher-ars@yandex.ru >
2022-03-04 01:10:42 +03:00
949f8b4633
Fix 1.59 rustc clippy warnings
2022-03-02 21:35:34 +02:00
a0f9a0d350
safekeeper to cosnole call fix ( #1333 ) ( #1334 )
2022-02-27 01:52:33 +03:00
Dmitry Rodionov
Heikki Linnakangas
Kirill Bulatov
Andrey Taranik
Dmitry Ivanov
Arseny Sher
Dhammika Pathirana
Anastasia Lubennikova
bojanserafimov