Commit Graph

338 Commits

Author SHA1 Message Date
Bojan Serafimov
0a59884b75 Update docs 2022-06-20 13:29:14 -04:00
Bojan Serafimov
1303cf77a3 Fix tests 2022-06-20 13:26:27 -04:00
Bojan Serafimov
3e647f8a27 WIP 2022-06-20 12:59:11 -04:00
Bojan Serafimov
cdab7bc83b Merge branch 'main' into basebackup-import 2022-06-18 15:21:50 -04:00
Bojan Serafimov
2ce653fd79 Add checksum todos 2022-06-18 11:19:02 -04:00
Bojan Serafimov
010132dbb0 Check file sizes 2022-06-18 11:14:21 -04:00
Bojan Serafimov
443e409950 Fix test 2022-06-18 10:48:21 -04:00
Bojan Serafimov
71afd06f83 Test failed import 2022-06-17 21:42:04 -04:00
Bojan Serafimov
45b470e206 Bump timeout 2022-06-17 16:30:29 -04:00
Anastasia Lubennikova
11d7743b39 basebackup import fixes (#1955) 2022-06-17 15:29:32 -04:00
Arthur Petukhovsky
f862373ac0 Fix WAL timeout in test_s3_wal_replay (#1953) 2022-06-17 20:43:54 +03:00
Arthur Petukhovsky
699f46cd84 Download WAL from S3 if it's not available in safekeeper dir (#1932)
`send_wal.rs` and `WalReader` are now async. `test_s3_wal_replay` checks that WAL can be replayed after offloaded.
2022-06-17 15:33:39 +03:00
Bojan Serafimov
e3ce99a711 Merge branch 'main' into basebackup-import 2022-06-16 22:00:21 -04:00
Bojan Serafimov
ee3462c6ea Attempt to fix flaky test 2022-06-16 21:38:59 -04:00
Anastasia Lubennikova
36ee182d26 Implement page servise 'fullbackup' endpoint (#1923)
* Implement page servise 'fullbackup' endpoint that works like basebackup, but also sends relational files

* Add test_runner/batch_others/test_fullbackup.py

Co-authored-by: bojanserafimov <bojan.serafimov7@gmail.com>
2022-06-16 14:07:11 +03:00
Anastasia Lubennikova
d11c9f9fcb Use random ports for the proxy and local pg in tests
Fixes #1931
Author: Dmitry Ivanov
2022-06-15 20:21:58 +03:00
Bojan Serafimov
670c8ab7be Merge branch 'basebackup-import' of github.com:neondatabase/neon into basebackup-import 2022-06-14 17:08:31 -04:00
Bojan Serafimov
05151e643f Merge branch 'main' into basebackup-import 2022-06-14 17:05:52 -04:00
Anastasia Lubennikova
9ccb7b75a6 Fix import of multi-segment relation files 2022-06-14 21:42:07 +03:00
Bojan Serafimov
909a0df048 Run yapf 2022-06-12 11:17:44 -04:00
Bojan Serafimov
a568c49111 WIP 2022-06-10 10:53:52 -04:00
Bojan Serafimov
ea97135fa8 Create user in test 2022-06-09 23:38:18 -04:00
Bojan Serafimov
31cf43724c WIP 2022-06-09 22:51:32 -04:00
Bojan Serafimov
1380a1cce1 Pass lsn 2022-06-09 12:39:29 -04:00
chaitanya sharma
e1336f451d renamed .zenith data-dir to .neon. 2022-06-09 18:19:18 +02:00
Egor Suvorov
0ac0fba77a test_runner: test Safekeeper HTTP API Auth
All endpoints except for POST /v1/timeline are tested, this one is not tested in any way yet.
Three attempts for each endpoint: correctly authenticated, badly authenticated, unauthenticated.
2022-06-09 17:14:46 +02:00
Egor Suvorov
a001052cdd test_runner: SafekeeperHttpClient: support auth 2022-06-09 17:14:46 +02:00
Egor Suvorov
1f1d852204 ZenithEnvBuilder: rename pageserver_auth_enabled --> auth_enabled 2022-06-09 17:14:46 +02:00
Arseny Sher
a51b2dac9a Don't s3 offload from newly joined safekeeper not having required WAL.
I made the check at launcher level with the perspective of generally moving
election (decision who offloads) there.

Also log timeline 'active' changes.
2022-06-09 18:30:16 +04:00
Bojan Serafimov
0277c37759 Don't compress tar 2022-06-08 19:31:23 -04:00
Bojan Serafimov
7fb732a39f Create timeline if not exists 2022-06-08 19:24:34 -04:00
Bojan Serafimov
ecee80d1bf Send tar 2022-06-08 14:37:46 -04:00
Bojan Serafimov
a39501beee Add todos 2022-06-08 10:36:35 -04:00
Bojan Serafimov
0677fb7ae7 Add neon_local command 2022-06-07 22:08:35 -04:00
Bojan Serafimov
99260b18ab Add test 2022-06-07 19:16:29 -04:00
Thang Pham
6cfebc096f Add read/write throughput performance tests (#1883)
Part of #1467 

This PR adds several performance tests that compare the [PG statistics](https://www.postgresql.org/docs/current/monitoring-stats.html) obtained when running PG benchmarks against Neon and vanilla PG to measure the read/write throughput of the DB.
2022-06-06 12:32:10 -04:00
Dmitry Rodionov
e442f5357b unify two identical failpoints in flush_frozen_layer
probably is a merge artfact
2022-06-03 19:36:09 +03:00
Arseny Sher
5a723d44cd Parametrize test_normal_work.
I like to run small test locally, but let's avoid duplication.
2022-06-03 20:32:53 +04:00
Arseny Sher
70a53c4b03 Get backup test_safekeeper_normal_work, but skip by default.
It is handy for development.
2022-06-03 16:12:14 +04:00
Kirill Bulatov
a91e0c299d Reproduce etcd parsing bug in Python tests 2022-06-03 00:23:13 +03:00
bojanserafimov
90e2c9ee1f Rename zenith to neon in python tests (#1871) 2022-06-02 16:21:28 -04:00
Kirill Bulatov
e5cb727572 Replace callmemaybe with etcd subscriptions on safekeeper timeline info 2022-06-01 16:07:04 +03:00
Dmitry Rodionov
b1b67cc5a0 improve test normal work to start several computes 2022-05-31 22:42:11 +03:00
Arseny Sher
36281e3b47 Extend test_wal_backup with compute restart. 2022-05-30 13:57:17 +04:00
Anastasia Lubennikova
e014cb6026 rename zenith.zenith_tenant to neon.tenant_id in test 2022-05-30 12:24:44 +03:00
Anastasia Lubennikova
67d6ff4100 Rename custom GUCs:
- zenith.zenith_tenant -> neon.tenant_id
- zenith.zenith_timeline -> neon.timeline_id
2022-05-30 11:11:01 +03:00
Anastasia Lubennikova
6a867bce6d Rename 'zenith_admin' role to 'cloud_admin' 2022-05-30 11:11:01 +03:00
Anastasia Lubennikova
751f1191b4 Rename 'wal_acceptors' GUC to 'safekeepers' 2022-05-30 11:11:01 +03:00
Anastasia Lubennikova
3accde613d Rename contrib/zenith to contrib/neon. Rename custom GUCs:
- zenith.page_server_connstring -> neon.pageserver_connstring
- zenith.zenith_tenant -> neon.tenantid
- zenith.zenith_timeline -> neon.timelineid
- zenith.max_cluster_size -> neon.max_cluster_size
2022-05-30 11:11:01 +03:00
Heikki Linnakangas
4b4d3073b8 Fix misc typos 2022-05-28 14:56:23 +03:00