Commit Graph
799 Commits
Author SHA1 Message Date
Bojan Serafimov 6463be13fc Fix typo 2022-06-14 17:07:34 -04:00
Bojan Serafimov 05151e643f Merge branch 'main' into basebackup-import 2022-06-14 17:05:52 -04:00
Bojan Serafimov 05b5ae32a1 Fix comment 2022-06-12 13:01:13 -04:00
Bojan Serafimov 23d4f12cdd Handle shutdown 2022-06-12 12:37:52 -04:00
Bojan Serafimov cd081280bf Improve errors 2022-06-12 12:23:43 -04:00
Bojan Serafimov 557fde6c57 fmt + clippy 2022-06-12 10:52:02 -04:00
Bojan Serafimov 2283eb871a Add assertion 2022-06-12 10:05:28 -04:00
Bojan Serafimov 938100058d Don't read all into memory 2022-06-11 15:55:52 -04:00
Kirill Bulatov d8a37452c8 Rename ZenithFeedback (#1912) 2022-06-11 00:44:05 +03:00
Bojan Serafimov 978ef167e0 Test works now 2022-06-10 13:54:02 -04:00
Bojan Serafimov a568c49111 WIP 2022-06-10 10:53:52 -04:00
Bojan Serafimov f03c14170d Fix bug. Should work now 2022-06-09 23:28:20 -04:00
Bojan Serafimov 31cf43724c WIP 2022-06-09 22:51:32 -04:00
Bojan Serafimov 1380a1cce1 Pass lsn 2022-06-09 12:39:29 -04:00
chaitanya sharma e1336f451d renamed .zenith data-dir to .neon. 2022-06-09 18:19:18 +02:00
Bojan Serafimov 5babab9461 Fix bug 2022-06-09 11:10:06 -04:00
Bojan Serafimov 7fca35e262 PG_VERSION is not a relfile 2022-06-09 10:57:10 -04:00
Bojan Serafimov 3dfdda4e49 Improve logs, fix bug 2022-06-09 10:53:13 -04:00
Bojan Serafimov b6b4424673 commit changes 2022-06-09 10:29:08 -04:00
Bojan Serafimov c59dea5390 Import relfiles, add todos 2022-06-09 00:09:51 -04:00
Bojan Serafimov 6a182b5c1b Fix protocol bug 2022-06-08 20:10:43 -04:00
Bojan Serafimov 7fb732a39f Create timeline if not exists 2022-06-08 19:24:34 -04:00
Bojan Serafimov 76b126be35 Implement Read 2022-06-08 18:41:38 -04:00
Bojan Serafimov 3e42367603 Copy tar reader 2022-06-08 15:57:01 -04:00
Bojan Serafimov ecee80d1bf Send tar 2022-06-08 14:37:46 -04:00
Bojan Serafimov db4be89577 Start working on api 2022-06-08 11:41:30 -04:00
Arthur Petukhovsky a01999bc4a Replace most common remote logs with metrics (#1909) 2022-06-08 13:36:49 +03:00
Kirill Bulatov 8a53472e4f Force etcd broker keys to not to intersect 2022-06-08 11:21:05 +03:00
Bojan Serafimov 0677fb7ae7 Add neon_local command 2022-06-07 22:08:35 -04:00
Dmitry Rodionov 6e26588d17 Allow to customize shutdown condition in PostgresBackend
Use it in PageServerHandler to check per thread shutdown condition
from thread_mgr which takes into account tenants and timelines
2022-06-07 22:11:54 +03:00
Dmitry Rodionov 7dc6beacbd make it possible to associate thread with a tenant after thread start 2022-06-07 12:59:35 +03:00
bojanserafimov 92de8423af Remove dead code (#1886) 2022-06-05 09:18:11 -04:00
Dmitry Rodionov e442f5357b unify two identical failpoints in flush_frozen_layer
probably is a merge artfact
2022-06-03 19:36:09 +03:00
Kirill Bulatov 2623193876 Remove pageserver_connstr from WAL stream logic 2022-06-03 17:30:36 +03:00
huming 9c846a93e8 chore(doc) 2022-06-03 14:24:27 +03:00
Kirill Bulatov 1d16ee92d4 Fix the Lsn difference reconnection 2022-06-03 00:23:13 +03:00
Kirill Bulatov b0c4ec0594 Log storage sync and etcd events a bit better 2022-06-03 00:23:13 +03:00
Egor Suvorov aba5e5f8b5 GitHub Actions: pin Rust version to 1.58 like on CircleCI
* Fix failing `cargo clippy` while we're here.
  The behavior has been changed in Rust 1.60: https://github.com/rust-lang/rust-clippy/issues/8928
* Add Rust version to the Cargo deps cache key
2022-06-02 17:45:53 +02:00
Ryan Russell c71faae2c6 Docs readability cont
Signed-off-by: Ryan Russell <git@ryanrussell.org>
2022-06-02 15:05:12 +02:00
Dmitry Rodionov 1188c9a95c remove extra span as this code is already covered by create timeline span
E g this log line contains duplicated data:
INFO /timeline_create{tenant=8d367870988250a755101b5189bbbc17
  new_timeline=Some(27e2580f51f5660642d8ce124e9ee4ac) lsn=None}:
  bootstrapping{timeline=27e2580f51f5660642d8ce124e9ee4ac
  tenant=8d367870988250a755101b5189bbbc17}:
  created root timeline 27e2580f51f5660642d8ce124e9ee4ac
  timeline.lsn 0/16960E8

this avoids variable duplication in `bootstrapping` subspan
2022-06-01 19:29:17 +03:00
Kirill Bulatov e5cb727572 Replace callmemaybe with etcd subscriptions on safekeeper timeline info 2022-06-01 16:07:04 +03:00
bojanserafimov ca10cc12c1 Close file descriptors for redo process (#1834) 2022-05-31 14:14:09 -04:00
Ryan Russell 54e163ac03 Improve Readability in Docs
Signed-off-by: Ryan Russell <ryanrussell@users.noreply.github.com>
2022-05-31 17:22:47 +03:00
Anastasia Lubennikova 6a867bce6d Rename 'zenith_admin' role to 'cloud_admin' 2022-05-30 11:11:01 +03:00
Anastasia Lubennikova 3accde613d Rename contrib/zenith to contrib/neon. Rename custom GUCs:
- zenith.page_server_connstring -> neon.pageserver_connstring
- zenith.zenith_tenant -> neon.tenantid
- zenith.zenith_timeline -> neon.timelineid
- zenith.max_cluster_size -> neon.max_cluster_size
2022-05-30 11:11:01 +03:00
Heikki Linnakangas 4b4d3073b8 Fix misc typos 2022-05-28 14:56:23 +03:00
Kian-Meng Ang f1c51a1267 Fix typos 2022-05-28 14:02:05 +03:00
Thang Pham 75f71a6380 Handle broken timelines on startup (#1809)
Resolve #1663.

## Changes

- ignore a "broken" [1] timeline on page server startup
- fix the race condition when creating multiple timelines in parallel for a tenant
- added tests for the above changes

[1]: a timeline is marked as "broken" if either
- failed to load the timeline's metadata or
- the timeline's disk consistent LSN is zero
2022-05-27 11:43:06 -04:00
Arseny SherandAnton Shyrabokau 0e1bd57c53 Add WAL offloading to s3 on safekeepers.
Separate task is launched for each timeline and stopped when timeline doesn't
need offloading. Decision who offloads is done through etcd leader election;
currently there is no pre condition for participating, that's a TODO.

neon_local and tests infrastructure for remote storage in safekeepers added,
along with the test itself.

ref #1009

Co-authored-by: Anton Shyrabokau <ahtoxa@Antons-MacBook-Pro.local>
2022-05-27 06:19:23 +04:00
Thang Pham 7d565aa4b9 Reduce the logging level when PG client disconnected to INFO (#1713)
Fixes #1683.
2022-05-26 12:21:15 -04:00