Commit Graph

1726 Commits

Author SHA1 Message Date
Bojan Serafimov
557fde6c57 fmt + clippy 2022-06-12 10:52:02 -04:00
Bojan Serafimov
2283eb871a Add assertion 2022-06-12 10:05:28 -04:00
Bojan Serafimov
938100058d Don't read all into memory 2022-06-11 15:55:52 -04:00
Bojan Serafimov
978ef167e0 Test works now 2022-06-10 13:54:02 -04:00
Bojan Serafimov
a568c49111 WIP 2022-06-10 10:53:52 -04:00
Bojan Serafimov
ea97135fa8 Create user in test 2022-06-09 23:38:18 -04:00
Bojan Serafimov
f03c14170d Fix bug. Should work now 2022-06-09 23:28:20 -04:00
Bojan Serafimov
31cf43724c WIP 2022-06-09 22:51:32 -04:00
Bojan Serafimov
1380a1cce1 Pass lsn 2022-06-09 12:39:29 -04:00
Bojan Serafimov
5babab9461 Fix bug 2022-06-09 11:10:06 -04:00
Bojan Serafimov
7fca35e262 PG_VERSION is not a relfile 2022-06-09 10:57:10 -04:00
Bojan Serafimov
3dfdda4e49 Improve logs, fix bug 2022-06-09 10:53:13 -04:00
Bojan Serafimov
b6b4424673 commit changes 2022-06-09 10:29:08 -04:00
Bojan Serafimov
c59dea5390 Import relfiles, add todos 2022-06-09 00:09:51 -04:00
Bojan Serafimov
6a182b5c1b Fix protocol bug 2022-06-08 20:10:43 -04:00
Bojan Serafimov
0277c37759 Don't compress tar 2022-06-08 19:31:23 -04:00
Bojan Serafimov
7fb732a39f Create timeline if not exists 2022-06-08 19:24:34 -04:00
Bojan Serafimov
76b126be35 Implement Read 2022-06-08 18:41:38 -04:00
Bojan Serafimov
3e42367603 Copy tar reader 2022-06-08 15:57:01 -04:00
Bojan Serafimov
ecee80d1bf Send tar 2022-06-08 14:37:46 -04:00
Bojan Serafimov
28acefb31f Add todos 2022-06-08 11:50:01 -04:00
Bojan Serafimov
db4be89577 Start working on api 2022-06-08 11:41:30 -04:00
Bojan Serafimov
a39501beee Add todos 2022-06-08 10:36:35 -04:00
Bojan Serafimov
0677fb7ae7 Add neon_local command 2022-06-07 22:08:35 -04:00
Bojan Serafimov
99260b18ab Add test 2022-06-07 19:16:29 -04:00
Dmitry Rodionov
6e26588d17 Allow to customize shutdown condition in PostgresBackend
Use it in PageServerHandler to check per thread shutdown condition
from thread_mgr which takes into account tenants and timelines
2022-06-07 22:11:54 +03:00
Arseny Sher
0b93253b3c Fix leaked keepalive task in s3 offloading leader election.
I still don't like the surroundings and feel we'd better get away without using
election API at all, but this is a quick fix to keep CI green.

ref #1815
2022-06-07 15:17:57 +04:00
Dmitry Rodionov
7dc6beacbd make it possible to associate thread with a tenant after thread start 2022-06-07 12:59:35 +03:00
Thang Pham
6cfebc096f Add read/write throughput performance tests (#1883)
Part of #1467 

This PR adds several performance tests that compare the [PG statistics](https://www.postgresql.org/docs/current/monitoring-stats.html) obtained when running PG benchmarks against Neon and vanilla PG to measure the read/write throughput of the DB.
2022-06-06 12:32:10 -04:00
KlimentSerafimov
fecad1ca34 Resolving issue #1745. Added cluster option for SNI data (#1813)
* Added project option in case SNI data is missing. Resolving issue #1745.

* Added invariant checking for project name: if both sni_data and project_name are available then they should match.
2022-06-06 08:14:41 -04:00
bojanserafimov
92de8423af Remove dead code (#1886) 2022-06-05 09:18:11 -04:00
Dmitry Rodionov
e442f5357b unify two identical failpoints in flush_frozen_layer
probably is a merge artfact
2022-06-03 19:36:09 +03:00
Arseny Sher
5a723d44cd Parametrize test_normal_work.
I like to run small test locally, but let's avoid duplication.
2022-06-03 20:32:53 +04:00
Kirill Bulatov
2623193876 Remove pageserver_connstr from WAL stream logic 2022-06-03 17:30:36 +03:00
Arseny Sher
70a53c4b03 Get backup test_safekeeper_normal_work, but skip by default.
It is handy for development.
2022-06-03 16:12:14 +04:00
Arseny Sher
9e108102b3 Silence etcd safekeeper info key parse errors.
When we subscribe to everything, it is ok to receive not only safekeeper
timeline updates.
2022-06-03 16:12:14 +04:00
huming
9c846a93e8 chore(doc) 2022-06-03 14:24:27 +03:00
Kirill Bulatov
c5007d3916 Remove unused module 2022-06-03 00:23:13 +03:00
Kirill Bulatov
5b06599770 Simplify etcd key regex parsing 2022-06-03 00:23:13 +03:00
Kirill Bulatov
1d16ee92d4 Fix the Lsn difference reconnection 2022-06-03 00:23:13 +03:00
Kirill Bulatov
7933804284 Fix and test regex parsing 2022-06-03 00:23:13 +03:00
Kirill Bulatov
a91e0c299d Reproduce etcd parsing bug in Python tests 2022-06-03 00:23:13 +03:00
Kirill Bulatov
b0c4ec0594 Log storage sync and etcd events a bit better 2022-06-03 00:23:13 +03:00
bojanserafimov
90e2c9ee1f Rename zenith to neon in python tests (#1871) 2022-06-02 16:21:28 -04:00
Egor Suvorov
aba5e5f8b5 GitHub Actions: pin Rust version to 1.58 like on CircleCI
* Fix failing `cargo clippy` while we're here.
  The behavior has been changed in Rust 1.60: https://github.com/rust-lang/rust-clippy/issues/8928
* Add Rust version to the Cargo deps cache key
2022-06-02 17:45:53 +02:00
Dmitry Rodionov
b155fe0e2f avoid perf test result context for pg regress 2022-06-02 17:41:34 +03:00
Ryan Russell
c71faae2c6 Docs readability cont
Signed-off-by: Ryan Russell <git@ryanrussell.org>
2022-06-02 15:05:12 +02:00
Kirill Bulatov
de7eda2dc6 Fix url path printing 2022-06-02 00:48:10 +03:00
Dmitry Rodionov
1188c9a95c remove extra span as this code is already covered by create timeline span
E g this log line contains duplicated data:
INFO /timeline_create{tenant=8d367870988250a755101b5189bbbc17
  new_timeline=Some(27e2580f51f5660642d8ce124e9ee4ac) lsn=None}:
  bootstrapping{timeline=27e2580f51f5660642d8ce124e9ee4ac
  tenant=8d367870988250a755101b5189bbbc17}:
  created root timeline 27e2580f51f5660642d8ce124e9ee4ac
  timeline.lsn 0/16960E8

this avoids variable duplication in `bootstrapping` subspan
2022-06-01 19:29:17 +03:00
Kirill Bulatov
e5cb727572 Replace callmemaybe with etcd subscriptions on safekeeper timeline info 2022-06-01 16:07:04 +03:00