b31ce411d2
Remove unnecessary map_err
2022-06-24 09:50:14 -04:00
24a5bd10a0
Add cancellation
2022-06-23 23:25:48 -04:00
2c029d9803
Remove redundant error context
2022-06-23 22:32:15 -04:00
763b00ccee
Merge branch 'tenant-tasks' of github.com:neondatabase/neon into tenant-tasks
2022-06-23 14:15:14 -04:00
c44c8a0ea0
Add comment
2022-06-23 14:14:39 -04:00
692496d733
Cancel tasks
2022-06-23 13:20:53 -04:00
0f4552a544
Update TODO
2022-06-23 12:59:20 -04:00
d7d4cc8c77
Error instead of panic
2022-06-23 12:56:21 -04:00
9aab1d0f2b
Expand blocking scope
2022-06-22 16:04:42 -04:00
83dc93ab0f
Merge branch 'main' into tenant-tasks
2022-06-22 14:49:45 -04:00
1ca28e6f3c
Import basebackup into pageserver ( #1925 )
...
Allow importing basebackup taken from vanilla postgres or another pageserver via psql copy in protocol.
2022-06-21 11:04:10 -04:00
36ee182d26
Implement page servise 'fullbackup' endpoint ( #1923 )
...
* Implement page servise 'fullbackup' endpoint that works like basebackup, but also sends relational files
* Add test_runner/batch_others/test_fullbackup.py
Co-authored-by: bojanserafimov <bojan.serafimov7@gmail.com >
2022-06-16 14:07:11 +03:00
9a9a58d52c
Fmt
2022-06-15 09:49:07 -04:00
865e8740a7
Add docs
2022-06-15 09:35:41 -04:00
1a5d1a15d0
Use tokio sleep instead
2022-06-15 09:33:56 -04:00
02a9883f0f
Add TenantTaskManager
2022-06-15 09:24:46 -04:00
ee36ca54d5
Run compaction as task
2022-06-15 09:16:57 -04:00
36cc6d2928
Fmt
2022-06-14 15:07:36 -04:00
e1a4c06918
Fix init
2022-06-14 15:05:30 -04:00
ec4528505e
Simplify
2022-06-14 12:38:09 -04:00
c79e72e835
Add runtime
2022-06-14 11:08:17 -04:00
a1f85715ac
WIP
2022-06-14 09:39:55 -04:00
d8a37452c8
Rename ZenithFeedback ( #1912 )
2022-06-11 00:44:05 +03:00
e1336f451d
renamed .zenith data-dir to .neon.
2022-06-09 18:19:18 +02:00
a01999bc4a
Replace most common remote logs with metrics ( #1909 )
2022-06-08 13:36:49 +03:00
8a53472e4f
Force etcd broker keys to not to intersect
2022-06-08 11:21:05 +03:00
6e26588d17
Allow to customize shutdown condition in PostgresBackend
...
Use it in PageServerHandler to check per thread shutdown condition
from thread_mgr which takes into account tenants and timelines
2022-06-07 22:11:54 +03:00
7dc6beacbd
make it possible to associate thread with a tenant after thread start
2022-06-07 12:59:35 +03:00
92de8423af
Remove dead code ( #1886 )
2022-06-05 09:18:11 -04:00
e442f5357b
unify two identical failpoints in flush_frozen_layer
...
probably is a merge artfact
2022-06-03 19:36:09 +03:00
2623193876
Remove pageserver_connstr from WAL stream logic
2022-06-03 17:30:36 +03:00
9c846a93e8
chore(doc)
2022-06-03 14:24:27 +03:00
1d16ee92d4
Fix the Lsn difference reconnection
2022-06-03 00:23:13 +03:00
b0c4ec0594
Log storage sync and etcd events a bit better
2022-06-03 00:23:13 +03:00
aba5e5f8b5
GitHub Actions: pin Rust version to 1.58 like on CircleCI
...
* Fix failing `cargo clippy` while we're here.
The behavior has been changed in Rust 1.60: https://github.com/rust-lang/rust-clippy/issues/8928
* Add Rust version to the Cargo deps cache key
2022-06-02 17:45:53 +02:00
c71faae2c6
Docs readability cont
...
Signed-off-by: Ryan Russell <git@ryanrussell.org >
2022-06-02 15:05:12 +02:00
1188c9a95c
remove extra span as this code is already covered by create timeline span
...
E g this log line contains duplicated data:
INFO /timeline_create{tenant=8d367870988250a755101b5189bbbc17
new_timeline=Some(27e2580f51f5660642d8ce124e9ee4ac) lsn=None}:
bootstrapping{timeline=27e2580f51f5660642d8ce124e9ee4ac
tenant=8d367870988250a755101b5189bbbc17}:
created root timeline 27e2580f51f5660642d8ce124e9ee4ac
timeline.lsn 0/16960E8
this avoids variable duplication in `bootstrapping` subspan
2022-06-01 19:29:17 +03:00
e5cb727572
Replace callmemaybe with etcd subscriptions on safekeeper timeline info
2022-06-01 16:07:04 +03:00
ca10cc12c1
Close file descriptors for redo process ( #1834 )
2022-05-31 14:14:09 -04:00
54e163ac03
Improve Readability in Docs
...
Signed-off-by: Ryan Russell <ryanrussell@users.noreply.github.com >
2022-05-31 17:22:47 +03:00
6a867bce6d
Rename 'zenith_admin' role to 'cloud_admin'
2022-05-30 11:11:01 +03:00
3accde613d
Rename contrib/zenith to contrib/neon. Rename custom GUCs:
...
- zenith.page_server_connstring -> neon.pageserver_connstring
- zenith.zenith_tenant -> neon.tenantid
- zenith.zenith_timeline -> neon.timelineid
- zenith.max_cluster_size -> neon.max_cluster_size
2022-05-30 11:11:01 +03:00
4b4d3073b8
Fix misc typos
2022-05-28 14:56:23 +03:00
f1c51a1267
Fix typos
2022-05-28 14:02:05 +03:00
75f71a6380
Handle broken timelines on startup ( #1809 )
...
Resolve #1663 .
## Changes
- ignore a "broken" [1] timeline on page server startup
- fix the race condition when creating multiple timelines in parallel for a tenant
- added tests for the above changes
[1]: a timeline is marked as "broken" if either
- failed to load the timeline's metadata or
- the timeline's disk consistent LSN is zero
2022-05-27 11:43:06 -04:00
0e1bd57c53
Add WAL offloading to s3 on safekeepers.
...
Separate task is launched for each timeline and stopped when timeline doesn't
need offloading. Decision who offloads is done through etcd leader election;
currently there is no pre condition for participating, that's a TODO.
neon_local and tests infrastructure for remote storage in safekeepers added,
along with the test itself.
ref #1009
Co-authored-by: Anton Shyrabokau <ahtoxa@Antons-MacBook-Pro.local >
2022-05-27 06:19:23 +04:00
7d565aa4b9
Reduce the logging level when PG client disconnected to INFO ( #1713 )
...
Fixes #1683 .
2022-05-26 12:21:15 -04:00
72a7220dc8
Tidy up some log messages
...
* turn println into an info with proper message
* rename new_local_timeline to load_local_timeline because it does not
create new timeline, it registers timeline that exists on disk in
pageserver in-memory structures
2022-05-26 18:37:40 +03:00
b0d114ee3f
Initialize last_freeze_at with disk consistent LSN to avoid creation of small L0 delta layer on startup
...
refer #1736
2022-05-26 15:42:18 +03:00
c584d90bb9
initial commit, renamed znodeid to nodeid.
2022-05-25 20:11:26 +03:00
Bojan Serafimov
Anastasia Lubennikova
Bojan Serafimov
Kirill Bulatov
chaitanya sharma
Arthur Petukhovsky
Dmitry Rodionov
huming
Egor Suvorov
Ryan Russell
Kirill Bulatov
Ryan Russell
Anastasia Lubennikova
Heikki Linnakangas
Kian-Meng Ang
Thang Pham
Arseny Sher
Konstantin Knizhnik