Commit Graph

1745 Commits

Author SHA1 Message Date
Bojan Serafimov
6463be13fc Fix typo 2022-06-14 17:07:34 -04:00
Bojan Serafimov
05151e643f Merge branch 'main' into basebackup-import 2022-06-14 17:05:52 -04:00
Bojan Serafimov
05b5ae32a1 Fix comment 2022-06-12 13:01:13 -04:00
Bojan Serafimov
23d4f12cdd Handle shutdown 2022-06-12 12:37:52 -04:00
Bojan Serafimov
cd081280bf Improve errors 2022-06-12 12:23:43 -04:00
Bojan Serafimov
909a0df048 Run yapf 2022-06-12 11:17:44 -04:00
Bojan Serafimov
557fde6c57 fmt + clippy 2022-06-12 10:52:02 -04:00
Bojan Serafimov
2283eb871a Add assertion 2022-06-12 10:05:28 -04:00
Bojan Serafimov
938100058d Don't read all into memory 2022-06-11 15:55:52 -04:00
Kirill Bulatov
d8a37452c8 Rename ZenithFeedback (#1912) 2022-06-11 00:44:05 +03:00
Bojan Serafimov
978ef167e0 Test works now 2022-06-10 13:54:02 -04:00
Bojan Serafimov
a568c49111 WIP 2022-06-10 10:53:52 -04:00
Bojan Serafimov
ea97135fa8 Create user in test 2022-06-09 23:38:18 -04:00
Bojan Serafimov
f03c14170d Fix bug. Should work now 2022-06-09 23:28:20 -04:00
Bojan Serafimov
31cf43724c WIP 2022-06-09 22:51:32 -04:00
Bojan Serafimov
1380a1cce1 Pass lsn 2022-06-09 12:39:29 -04:00
chaitanya sharma
e1336f451d renamed .zenith data-dir to .neon. 2022-06-09 18:19:18 +02:00
Arseny Sher
a4d8261390 Save Postgres log in test_find_end_of_wal_* tests. 2022-06-09 19:16:43 +04:00
Egor Suvorov
e2a5a31595 Safekeeper HTTP router: add comment about /v1/timeline 2022-06-09 17:14:46 +02:00
Egor Suvorov
0ac0fba77a test_runner: test Safekeeper HTTP API Auth
All endpoints except for POST /v1/timeline are tested, this one is not tested in any way yet.
Three attempts for each endpoint: correctly authenticated, badly authenticated, unauthenticated.
2022-06-09 17:14:46 +02:00
Egor Suvorov
a001052cdd test_runner: SafekeeperHttpClient: support auth 2022-06-09 17:14:46 +02:00
Egor Suvorov
1f1d852204 ZenithEnvBuilder: rename pageserver_auth_enabled --> auth_enabled 2022-06-09 17:14:46 +02:00
Egor Suvorov
f7b878611a Implement JWT authentication in Safekeeper HTTP API (#1753)
* `control_plane` crate (used by `neon_local`) now parses an `auth_enabled` bool for each Safekeeper
* If auth is enabled, a Safekeeper is passed a path to a public key via a new command line argument
* Added TODO comments to other places needing auth
2022-06-09 17:14:46 +02:00
Bojan Serafimov
5babab9461 Fix bug 2022-06-09 11:10:06 -04:00
Bojan Serafimov
7fca35e262 PG_VERSION is not a relfile 2022-06-09 10:57:10 -04:00
Bojan Serafimov
3dfdda4e49 Improve logs, fix bug 2022-06-09 10:53:13 -04:00
Arseny Sher
a51b2dac9a Don't s3 offload from newly joined safekeeper not having required WAL.
I made the check at launcher level with the perspective of generally moving
election (decision who offloads) there.

Also log timeline 'active' changes.
2022-06-09 18:30:16 +04:00
Bojan Serafimov
b6b4424673 commit changes 2022-06-09 10:29:08 -04:00
Bojan Serafimov
c59dea5390 Import relfiles, add todos 2022-06-09 00:09:51 -04:00
Bojan Serafimov
6a182b5c1b Fix protocol bug 2022-06-08 20:10:43 -04:00
Bojan Serafimov
0277c37759 Don't compress tar 2022-06-08 19:31:23 -04:00
Bojan Serafimov
7fb732a39f Create timeline if not exists 2022-06-08 19:24:34 -04:00
Bojan Serafimov
76b126be35 Implement Read 2022-06-08 18:41:38 -04:00
Bojan Serafimov
3e42367603 Copy tar reader 2022-06-08 15:57:01 -04:00
Bojan Serafimov
ecee80d1bf Send tar 2022-06-08 14:37:46 -04:00
Bojan Serafimov
28acefb31f Add todos 2022-06-08 11:50:01 -04:00
Bojan Serafimov
db4be89577 Start working on api 2022-06-08 11:41:30 -04:00
Bojan Serafimov
a39501beee Add todos 2022-06-08 10:36:35 -04:00
Thang Pham
e22d9cee3a fix ZeroDivisionError in scripts/generate_perf_report_page (#1906)
Fixes the `ZeroDivisionError` error by adding `EPS=1e-6` when doing the calculation.
2022-06-08 09:15:12 -04:00
Arthur Petukhovsky
a01999bc4a Replace most common remote logs with metrics (#1909) 2022-06-08 13:36:49 +03:00
chaitanya sharma
32e64afd54 Use better parallel build instructions in readme.md (#1908) 2022-06-08 11:25:37 +03:00
Kirill Bulatov
8a53472e4f Force etcd broker keys to not to intersect 2022-06-08 11:21:05 +03:00
Bojan Serafimov
0677fb7ae7 Add neon_local command 2022-06-07 22:08:35 -04:00
Bojan Serafimov
99260b18ab Add test 2022-06-07 19:16:29 -04:00
Dmitry Rodionov
6e26588d17 Allow to customize shutdown condition in PostgresBackend
Use it in PageServerHandler to check per thread shutdown condition
from thread_mgr which takes into account tenants and timelines
2022-06-07 22:11:54 +03:00
Arseny Sher
0b93253b3c Fix leaked keepalive task in s3 offloading leader election.
I still don't like the surroundings and feel we'd better get away without using
election API at all, but this is a quick fix to keep CI green.

ref #1815
2022-06-07 15:17:57 +04:00
Dmitry Rodionov
7dc6beacbd make it possible to associate thread with a tenant after thread start 2022-06-07 12:59:35 +03:00
Thang Pham
6cfebc096f Add read/write throughput performance tests (#1883)
Part of #1467 

This PR adds several performance tests that compare the [PG statistics](https://www.postgresql.org/docs/current/monitoring-stats.html) obtained when running PG benchmarks against Neon and vanilla PG to measure the read/write throughput of the DB.
2022-06-06 12:32:10 -04:00
KlimentSerafimov
fecad1ca34 Resolving issue #1745. Added cluster option for SNI data (#1813)
* Added project option in case SNI data is missing. Resolving issue #1745.

* Added invariant checking for project name: if both sni_data and project_name are available then they should match.
2022-06-06 08:14:41 -04:00
bojanserafimov
92de8423af Remove dead code (#1886) 2022-06-05 09:18:11 -04:00