Dmitry Rodionov
0be7ed0cb5
decrease log message severity for timeline checkpoint internals
2022-03-23 18:20:43 +04:00
Dmitry Rodionov
e80ae4306a
change log level from info to debug for timeline gc messages
2022-03-23 18:20:43 +04:00
Heikki Linnakangas
123fcd5d0d
Revert accidental bump of vendor/postgres submodule
...
I accidentally bumped it in commit 3b069f5aef
2022-03-23 15:45:29 +02:00
Kirill Bulatov
15434ba7e0
Show cachepot build stats
2022-03-23 14:12:59 +02:00
Andrey Taranik
a4d0d78e9e
s3 settings for pageserver ( #1388 )
2022-03-23 13:39:55 +03:00
Dmitry Rodionov
e13bdd77fe
add safekepeers gossip annd storage messaging rfcs
...
they were in prs during rfc repo import
in addition to just import I've added sequence diagrams to storage
messaging rfc
2022-03-22 15:01:26 +04:00
Kirill Bulatov
bd6bef468c
Provide single list timelines HTTP API handle
2022-03-21 13:42:21 +02:00
Kirill Bulatov
77ed2a0fa0
Run GitHub testing workflow on every push
2022-03-21 12:46:33 +02:00
Kirill Bulatov
37ebbb598d
Add a macOs build
2022-03-21 12:46:33 +02:00
Kirill Bulatov
063f9ba81d
Use serde_with to (de)serialize ZId and Lsn to hex
2022-03-21 12:46:07 +02:00
Heikki Linnakangas
3b069f5aef
Fix name of directory used in unit test.
...
There's another test called 'timeline_load'. If the two tests run in
parallel, they would conflict and fail.
2022-03-18 21:27:48 +02:00
Dmitry Rodionov
b19870cd88
guard against partial uploads to local storage
2022-03-18 18:14:57 +03:00
Dmitry Rodionov
7738254f83
refactor timeline memory state management
2022-03-18 18:14:57 +03:00
Dmitry Ivanov
a7544eead5
Remove the last non-borrowed string from BeMessage ( #1376 )
2022-03-17 16:46:58 +03:00
Andrey Taranik
ab124c161b
Merge branch 'release' into main
2022-03-17 00:05:51 +03:00
Andrey Taranik
1fddb0556f
deploy playbook fix - interaction with console ( #1374 )
2022-03-17 00:01:17 +03:00
Andrey Taranik
15a2a2bf04
release 2202-03-16 ( #1373 )
...
production deploy
2022-03-16 23:00:01 +03:00
Dmitry Ivanov
705f51db27
[proxy] Propagate some errors to user ( #1329 )
...
* [proxy] Propagate most errors to user
This change enables propagation of most errors to the user
(e.g. auth and connectivity errors). Some of them will be
stripped of sensitive information.
As a side effect, most occurrences of `anyhow::Error` were
replaced with concrete error types.
* [proxy] Box weighty errors
2022-03-16 21:20:04 +03:00
Heikki Linnakangas
9c1a9a1d9f
Update Cargo.lock for new dependencies ( #1354 )
...
Commit b2ad8342d2
2022-03-14 21:06:25 +03:00
Arseny Sher
d5a96d3d50
Fix finding end of WAL on safekeepers after f86cf93435.
...
That commit dropped wal_start_lsn, now we're looking since commit_lsn, which is
the real end of WAL if no records follow it.
ref #1351
2022-03-14 18:54:59 +03:00
Heikki Linnakangas
d93fc371f3
Import all existing RFCs documents from the separate 'rfcs' repository.
2022-03-11 18:49:36 +02:00
Dhammika Pathirana
5d7bd8643a
Fix page reconstruct time histo
...
Signed-off-by: Dhammika Pathirana <dhammika@gmail.com >
2022-03-10 14:42:28 -08:00
Dhammika Pathirana
a8a7dc9ca6
Fix zid encoding
...
Signed-off-by: Dhammika Pathirana <dhammika@gmail.com >
2022-03-10 14:42:28 -08:00
Dhammika Pathirana
b2ad8342d2
Add zid stringify bench test
...
Signed-off-by: Dhammika Pathirana <dhammika@gmail.com >
2022-03-10 14:42:28 -08:00
Dhammika Pathirana
27dadba52c
Fix retain references to layer histograms
...
Signed-off-by: Dhammika Pathirana <dhammika@gmail.com >
2022-03-10 14:42:28 -08:00
Dhammika Pathirana
f67d010d1b
Add ps smgr/storage metrics tenant tags
...
Signed-off-by: Dhammika Pathirana <dhammika@gmail.com >
Add tenant_id,timeline_id in smgr/storage metrics (#1234 )
2022-03-10 14:42:28 -08:00
Kirill Bulatov
093ad8ab59
Send 409 HTTP responses on timeline and tenant creation for existing entity
2022-03-10 19:38:58 +02:00
Kirill Bulatov
c51d545fd9
Serialize Lsn as strings in http api
2022-03-10 19:38:58 +02:00
Kirill Bulatov
fe6fccfdae
Allow already existing repo when creating a tenant
2022-03-10 19:38:58 +02:00
Kirill Bulatov
dd74c66ef0
Do not create timeline along with tenant
2022-03-10 19:38:58 +02:00
Kirill Bulatov
a5e10c4f64
Tidy up pageserver's endpoints
2022-03-10 19:38:58 +02:00
Kirill Bulatov
7b5482bac0
Properly store the branch name mappings
2022-03-10 19:38:58 +02:00
Kirill Bulatov
c7569dce47
Allow passing initial timeline id into zenith CLI commands
2022-03-10 19:38:58 +02:00
Kirill Bulatov
4d0f7fd1e4
Update Zenith CLI config between runs
2022-03-10 19:38:58 +02:00
Kirill Bulatov
f49990ed43
Allow creating timelines by branching off ancestors
2022-03-10 19:38:58 +02:00
Kirill Bulatov
0c91091c63
Avoid point in time concept on pageserver level
2022-03-10 19:38:58 +02:00
Kirill Bulatov
10f811e886
Use timeline instead of branch in pageserver's API
2022-03-10 19:38:58 +02:00
Anastasia Lubennikova
2883a25761
Bump vendor/postgres to use local relation cache for smgr_exists
2022-03-10 17:36:09 +04:00
anastasia
87f306c516
Tune backpressure in python tests to make them more stable
2022-03-10 17:36:09 +04:00
anastasia
5b34afe893
Bump vendor/postgres to use local relation cache for smgr_exists
2022-03-10 17:36:09 +04:00
bojanserafimov
15b19a0a57
[proxy] Test connstr options ( #1344 )
...
* Add proxy test
* Fix typo
2022-03-09 22:47:06 +03:00
Andrey Taranik
934bbcba0f
revert docker build to debian:buster based rust ( #1347 )
...
* dockerfile fix, rust cache in docker build flow
* check rust cachepot
* another check rust cachepot
* cleanup
* revert docker build to debian:buster based rust to avoid libc6 version mismatch
2022-03-09 10:13:46 +03:00
Andrey Taranik
cffac59a41
Docker improvement ( #1345 )
...
* dockerfile fix, rust cache in docker build flow
* check rust cachepot
* another check rust cachepot
* cleanup
2022-03-08 23:19:49 +03:00
Arseny Sher
8e37d345a8
Adjust safekeeper detailed logging to batch fsyncing.
2022-03-08 08:07:00 +03:00
Arseny Sher
f86cf93435
Refactor timeline creation on safekeepers, allowing storing peer ids.
...
Have separate routine and http endpoint to create timeline on safekeepers. It is
not used yet, i.e. timeline is still created implicitly, but we'll change that
once infrastructure for learning which tlis are assigned to which safekeepers
will be ready, preventing accidental creation by compute.
Changes format of safekeeper control file, allowing to store set of
peers. Knowing peers provides a part of foundation for peer
recovery (calculating min horizons like truncate_lsn for WAL truncation and
commit_lsn for sync-safekeepers replacement) and proper membership change;
similarly, we don't yet use it for now.
Employing cf file version bump, extracts tenant_id and timeline_id to top level
where it is more suitable. Also adds a bunch of LSNs there and rename
truncate_lsn to more specific peer_horizon_lsn.
2022-03-06 08:06:38 +03:00
Kirill Bulatov
66eb2a1dd3
Replace zenith/build build image with zimg/* ones
2022-03-04 13:46:44 +02:00
Kirill Bulatov
9424bfae22
Use a separate newtype for ZId that (de)serialize as hex strings
2022-03-04 10:58:40 +02:00
Dmitry Rodionov
1d90b1b205
add node id to pageserver ( #1310 )
...
* Add --id argument to safekeeper setting its unique u64 id.
In preparation for storage node messaging. IDs are supposed to be monotonically
assigned by the console. In tests it is issued by ZenithEnv; at the zenith cli
level and fixtures, string name is completely replaced by integer id. Example
TOML configs are adjusted accordingly.
Sequential ids are chosen over Zid mainly because they are compact and easy to
type/remember.
* add node id to pageserver
This adds node id parameter to pageserver configuration. Also I use a
simple builder to construct pageserver config struct to avoid setting
node id to some temporary invalid value. Some of the changes in test
fixtures are needed to split init and start operations for envrionment.
Co-authored-by: Arseny Sher <sher-ars@yandex.ru >
2022-03-04 01:10:42 +03:00
Kirill Bulatov
949f8b4633
Fix 1.59 rustc clippy warnings
2022-03-02 21:35:34 +02:00
Andrey Taranik
a0f9a0d350
safekeeper to cosnole call fix ( #1333 ) ( #1334 )
2022-02-27 01:52:33 +03:00
