Bojan Serafimov
cdc81996b4
Add metrics
2022-06-24 15:28:53 -04:00
Bojan Serafimov
1169e9ea4c
Rename threads to tasks
2022-06-24 11:08:55 -04:00
Bojan Serafimov
3a23869780
Log errors
2022-06-24 11:05:07 -04:00
Bojan Serafimov
796ee4d8af
Instrument the task, not the await
2022-06-24 10:29:42 -04:00
Bojan Serafimov
b31ce411d2
Remove unnecessary map_err
2022-06-24 09:50:14 -04:00
Bojan Serafimov
24a5bd10a0
Add cancellation
2022-06-23 23:25:48 -04:00
Bojan Serafimov
2c029d9803
Remove redundant error context
2022-06-23 22:32:15 -04:00
Bojan Serafimov
763b00ccee
Merge branch 'tenant-tasks' of github.com:neondatabase/neon into tenant-tasks
2022-06-23 14:15:14 -04:00
Bojan Serafimov
c44c8a0ea0
Add comment
2022-06-23 14:14:39 -04:00
Bojan Serafimov
692496d733
Cancel tasks
2022-06-23 13:20:53 -04:00
Bojan Serafimov
0f4552a544
Update TODO
2022-06-23 12:59:20 -04:00
Bojan Serafimov
d7d4cc8c77
Error instead of panic
2022-06-23 12:56:21 -04:00
Bojan Serafimov
9aab1d0f2b
Expand blocking scope
2022-06-22 16:04:42 -04:00
Bojan Serafimov
83dc93ab0f
Merge branch 'main' into tenant-tasks
2022-06-22 14:49:45 -04:00
bojanserafimov
1ca28e6f3c
Import basebackup into pageserver ( #1925 )
...
Allow importing basebackup taken from vanilla postgres or another pageserver via psql copy in protocol.
2022-06-21 11:04:10 -04:00
Anastasia Lubennikova
36ee182d26
Implement page servise 'fullbackup' endpoint ( #1923 )
...
* Implement page servise 'fullbackup' endpoint that works like basebackup, but also sends relational files
* Add test_runner/batch_others/test_fullbackup.py
Co-authored-by: bojanserafimov <bojan.serafimov7@gmail.com >
2022-06-16 14:07:11 +03:00
Bojan Serafimov
9a9a58d52c
Fmt
2022-06-15 09:49:07 -04:00
Bojan Serafimov
865e8740a7
Add docs
2022-06-15 09:35:41 -04:00
Bojan Serafimov
1a5d1a15d0
Use tokio sleep instead
2022-06-15 09:33:56 -04:00
Bojan Serafimov
02a9883f0f
Add TenantTaskManager
2022-06-15 09:24:46 -04:00
Bojan Serafimov
ee36ca54d5
Run compaction as task
2022-06-15 09:16:57 -04:00
Bojan Serafimov
36cc6d2928
Fmt
2022-06-14 15:07:36 -04:00
Bojan Serafimov
e1a4c06918
Fix init
2022-06-14 15:05:30 -04:00
Bojan Serafimov
ec4528505e
Simplify
2022-06-14 12:38:09 -04:00
Bojan Serafimov
c79e72e835
Add runtime
2022-06-14 11:08:17 -04:00
Bojan Serafimov
a1f85715ac
WIP
2022-06-14 09:39:55 -04:00
Kirill Bulatov
d8a37452c8
Rename ZenithFeedback ( #1912 )
2022-06-11 00:44:05 +03:00
chaitanya sharma
e1336f451d
renamed .zenith data-dir to .neon.
2022-06-09 18:19:18 +02:00
Arthur Petukhovsky
a01999bc4a
Replace most common remote logs with metrics ( #1909 )
2022-06-08 13:36:49 +03:00
Kirill Bulatov
8a53472e4f
Force etcd broker keys to not to intersect
2022-06-08 11:21:05 +03:00
Dmitry Rodionov
6e26588d17
Allow to customize shutdown condition in PostgresBackend
...
Use it in PageServerHandler to check per thread shutdown condition
from thread_mgr which takes into account tenants and timelines
2022-06-07 22:11:54 +03:00
Dmitry Rodionov
7dc6beacbd
make it possible to associate thread with a tenant after thread start
2022-06-07 12:59:35 +03:00
bojanserafimov
92de8423af
Remove dead code ( #1886 )
2022-06-05 09:18:11 -04:00
Dmitry Rodionov
e442f5357b
unify two identical failpoints in flush_frozen_layer
...
probably is a merge artfact
2022-06-03 19:36:09 +03:00
Kirill Bulatov
2623193876
Remove pageserver_connstr from WAL stream logic
2022-06-03 17:30:36 +03:00
huming
9c846a93e8
chore(doc)
2022-06-03 14:24:27 +03:00
Kirill Bulatov
1d16ee92d4
Fix the Lsn difference reconnection
2022-06-03 00:23:13 +03:00
Kirill Bulatov
b0c4ec0594
Log storage sync and etcd events a bit better
2022-06-03 00:23:13 +03:00
Egor Suvorov
aba5e5f8b5
GitHub Actions: pin Rust version to 1.58 like on CircleCI
...
* Fix failing `cargo clippy` while we're here.
The behavior has been changed in Rust 1.60: https://github.com/rust-lang/rust-clippy/issues/8928
* Add Rust version to the Cargo deps cache key
2022-06-02 17:45:53 +02:00
Ryan Russell
c71faae2c6
Docs readability cont
...
Signed-off-by: Ryan Russell <git@ryanrussell.org >
2022-06-02 15:05:12 +02:00
Dmitry Rodionov
1188c9a95c
remove extra span as this code is already covered by create timeline span
...
E g this log line contains duplicated data:
INFO /timeline_create{tenant=8d367870988250a755101b5189bbbc17
new_timeline=Some(27e2580f51f5660642d8ce124e9ee4ac) lsn=None}:
bootstrapping{timeline=27e2580f51f5660642d8ce124e9ee4ac
tenant=8d367870988250a755101b5189bbbc17}:
created root timeline 27e2580f51f5660642d8ce124e9ee4ac
timeline.lsn 0/16960E8
this avoids variable duplication in `bootstrapping` subspan
2022-06-01 19:29:17 +03:00
Kirill Bulatov
e5cb727572
Replace callmemaybe with etcd subscriptions on safekeeper timeline info
2022-06-01 16:07:04 +03:00
bojanserafimov
ca10cc12c1
Close file descriptors for redo process ( #1834 )
2022-05-31 14:14:09 -04:00
Ryan Russell
54e163ac03
Improve Readability in Docs
...
Signed-off-by: Ryan Russell <ryanrussell@users.noreply.github.com >
2022-05-31 17:22:47 +03:00
Anastasia Lubennikova
6a867bce6d
Rename 'zenith_admin' role to 'cloud_admin'
2022-05-30 11:11:01 +03:00
Anastasia Lubennikova
3accde613d
Rename contrib/zenith to contrib/neon. Rename custom GUCs:
...
- zenith.page_server_connstring -> neon.pageserver_connstring
- zenith.zenith_tenant -> neon.tenantid
- zenith.zenith_timeline -> neon.timelineid
- zenith.max_cluster_size -> neon.max_cluster_size
2022-05-30 11:11:01 +03:00
Heikki Linnakangas
4b4d3073b8
Fix misc typos
2022-05-28 14:56:23 +03:00
Kian-Meng Ang
f1c51a1267
Fix typos
2022-05-28 14:02:05 +03:00
Thang Pham
75f71a6380
Handle broken timelines on startup ( #1809 )
...
Resolve #1663 .
## Changes
- ignore a "broken" [1] timeline on page server startup
- fix the race condition when creating multiple timelines in parallel for a tenant
- added tests for the above changes
[1]: a timeline is marked as "broken" if either
- failed to load the timeline's metadata or
- the timeline's disk consistent LSN is zero
2022-05-27 11:43:06 -04:00
Arseny Sher
0e1bd57c53
Add WAL offloading to s3 on safekeepers.
...
Separate task is launched for each timeline and stopped when timeline doesn't
need offloading. Decision who offloads is done through etcd leader election;
currently there is no pre condition for participating, that's a TODO.
neon_local and tests infrastructure for remote storage in safekeepers added,
along with the test itself.
ref #1009
Co-authored-by: Anton Shyrabokau <ahtoxa@Antons-MacBook-Pro.local >
2022-05-27 06:19:23 +04:00
