Bojan Serafimov
c8f47cd38e
Fix param name
2022-02-21 16:43:28 +03:00
Bojan Serafimov
92787159f7
Add client auth method option
2022-02-21 16:43:28 +03:00
anastasia
abb422d5de
Fix SafekeeperMetrics parsing in python tests
2022-02-21 13:45:22 +03:00
bojanserafimov
fdc15de8b2
Add perf test: test_random_writes ( #1292 )
2022-02-18 15:46:29 -05:00
Stas Kelvich
207286f2b8
Actualize branching parts of openapi spec.
...
Previous version of spec caused parsing errors in generated clients
as return type is object not array, also one field was missing. In
a passing set `format: hex` on ancestor_id too as value conforms to
that format.
2022-02-18 20:22:21 +02:00
Dhammika Pathirana
d2b896381a
Add safekeeper tenant tags in lsn/wal metrics
...
Signed-off-by: Dhammika Pathirana <dhammika@gmail.com >
Add tenant_id in lsn/wal metrics (#1234 )
2022-02-18 08:26:37 -08:00
Dhammika Pathirana
009f6d4ae8
Fix safekeeper metric tags
...
Signed-off-by: Dhammika Pathirana <dhammika@gmail.com >
Use separate tags in sk storage file histo (#1234 )
2022-02-18 08:26:37 -08:00
Kirill Bulatov
1b31379456
Log postgres errors with ERROR level
2022-02-17 13:42:09 +02:00
Bojan Serafimov
4c64b10aec
Revert removal of ignore hint
2022-02-17 13:41:49 +02:00
Bojan Serafimov
ad262a46ad
Remove redundant pytest_plugins assignment
2022-02-17 13:41:49 +02:00
Kirill Bulatov
ce533835e5
Use uuid.UUID types for tenants and timelines more
2022-02-17 13:41:19 +02:00
Kirill Bulatov
e5bf520b18
Use types in zenith cli invocations in Python tests
2022-02-17 13:41:19 +02:00
Dmitry Rodionov
9512e21b9e
fix python formatting
2022-02-17 13:22:14 +03:00
Dmitry Ivanov
a26d565282
[proxy] Replace private static map with a public CancelMap
...
This is a cleaner approach which might facilitate testing.
2022-02-17 11:54:27 +03:00
Dmitry Ivanov
a47dade622
[proxy] Migrate to async
...
This change makes most parts of the code asynchronous, except
for the `mgmt` subsystem (we're going to drop it anyway).
Co-authored-by: bojanserafimov <bojan.serafimov7@gmail.com >
2022-02-17 11:54:27 +03:00
Dmitry Rodionov
9cce430430
remove several obsolete management api commands from pageserver's libpq
...
api
these commands are now available via http api
2022-02-17 11:26:28 +03:00
Dhammika Pathirana
4bf4bacf01
Add cli start/stop test
...
Signed-off-by: Dhammika Pathirana <dhammika@gmail.com >
Add a test for #1260
2022-02-16 13:19:12 -08:00
bojanserafimov
335abfcc28
Add slow seqscan perf test ( #1283 )
2022-02-16 10:59:51 -05:00
bojanserafimov
afb3342e46
Add vanilla pg baseline tests ( #1275 )
2022-02-15 13:44:22 -05:00
Kirill Bulatov
5563ff123f
Reuse tenant-timeline id struct from utils
2022-02-15 17:45:23 +02:00
Dhammika Pathirana
0a557b2fa9
Add cli v4 loopback listener ports test
...
Signed-off-by: Dhammika Pathirana <dhammika@gmail.com >
Add a test for #1247
2022-02-15 17:01:22 +02:00
Heikki Linnakangas
9632c352ab
Avoid having multiple records for the same page and LSN.
...
If a heap UPDATE record modified two pages, and both pages needed to have
their VM bits cleared, and the VM bits were located on the same VM page,
we would emit two ZenithWalRecord::ClearVisibilityMapFlags records for
the same VM page. That produced warnings like this in the pageserver log:
Page version Wal(ClearVisibilityMapFlags { heap_blkno: 18, flags: 3 }) of rel 1663/13949/2619_vm blk 0 at 2A/346046A0 already exists
To fix, change ClearVisibilityMapFlags so that it can update the bits
for both pages as one operation.
This was already covered by several python tests, so no need to add a
new one. Fixes #1125 .
Co-authored-by: Konstantin Knizhnik <knizhnik@zenith.tech >
2022-02-15 14:26:16 +02:00
Arseny Sher
328e3b4189
bump vendor/postgres to fix compiler warnings
2022-02-15 06:51:16 +03:00
Arseny Sher
47f6a1f9a8
Add -Werror to CI builds.
2022-02-15 06:51:16 +03:00
Dmitry Rodionov
a4829712f4
merge directories in git-upload instead of removing existing files for perf test result uploads
2022-02-15 03:47:06 +03:00
Arseny Sher
d4d26f619d
bump vendor/postgres to fix compilation warning
2022-02-14 21:00:11 +03:00
Arseny Sher
36481f3374
bump vendor/postgres to init pgxactoff in walproposer
...
ref #1244
2022-02-14 15:57:38 +03:00
Dhammika Pathirana
d951dd8977
Fix cli start ( #1260 )
...
Signed-off-by: Dhammika Pathirana <dhammika@gmail.com >
2022-02-10 18:36:02 -05:00
bojanserafimov
ea13838be7
Add pgbench baseline test ( #1204 )
...
Co-authored-by: Heikki Linnakangas <heikki.linnakangas@iki.fi >
2022-02-10 15:33:36 -05:00
Dmitry Rodionov
b51f23cdf0
pass perf test cluster connstr to circle ci jobs
2022-02-10 17:49:54 +03:00
Kirill Bulatov
3cfcdb92ed
Fix tokio features in zenith utils to enable its standalone compilation
2022-02-10 08:33:22 -05:00
Kirill Bulatov
d7af965982
Do not leak decoding_key in JwtAuth's Debug representation
2022-02-10 08:33:22 -05:00
Kirill Bulatov
7c1c7702d2
Code review fixes
2022-02-10 08:33:22 -05:00
Kirill Bulatov
6eef401602
Move routerify behind zenith_utils
2022-02-10 08:33:22 -05:00
Kirill Bulatov
c5b5905ed3
Remove parking_lot dependency from workspace
2022-02-10 08:33:22 -05:00
Kirill Bulatov
76b74349cb
Bump pageserver dependencies
2022-02-10 08:33:22 -05:00
Dmitry Rodionov
b08e340f60
point perf results back from testing to master
2022-02-10 14:18:34 +03:00
Dmitry Rodionov
a25fa29bc9
modify git-upload for generate_and_push_perf_report.sh needs
2022-02-10 13:12:19 +03:00
Dmitry Rodionov
ccf3c8cc30
store performance test results in our staging cluster to be able to
...
visualize them in grafana
2022-02-10 13:12:19 +03:00
Heikki Linnakangas
c45ee13b4e
Bump vendor/postgres, to fix memory leak.
...
See https://github.com/zenithdb/postgres/pull/129
2022-02-10 11:29:38 +02:00
anastasia
f1e7db9d0d
Bump vendor/postgres rebased to 14.2
2022-02-10 11:19:10 +03:00
Heikki Linnakangas
fa8a6c0e94
Reduce logging of walkeeper normal operations.
...
It was printing a lot of stuff to the log with INFO level, for routine
things like receiving or sending messages. Reduce the noise. The amount
of logging was excessive, and it was also consuming a fair amount of CPU
(about 20% of safekeeper's CPU usage in a little test I ran).
2022-02-10 08:34:30 +02:00
Dhammika Pathirana
1e8ca497e0
Fix safekeeper loopback addr ( #1247 )
...
Signed-off-by: Dhammika Pathirana <dhammika@gmail.com >
2022-02-10 09:23:53 +03:00
Heikki Linnakangas
a504cc87ab
Bump vendor/postgres for "Make getpage requests interruptible"
...
See https://github.com/zenithdb/zenith/issues/1224
2022-02-09 16:13:46 +02:00
Heikki Linnakangas
5268bbc840
Bump vendor/postgres for fixes to cluster size limit.
...
See https://github.com/zenithdb/postgres/pull/126
2022-02-09 15:52:21 +02:00
Arseny Sher
e1d770939b
Bump vendor/postgres to fix recent CI failure.
...
See zenithdb/postgres#127
2022-02-09 08:50:45 -05:00
Egor Suvorov
2866a9e82e
Fix safekeeper LSN metrics ( #1216 )
...
* Always initialize flush_lsn/commit_lsn metrics on a specific timeline, no more `n/a`
* Update flush_lsn metrics missing from cba4da3f4d
* Ensure that flush_lsn found on load is >= than both commit_lsn and truncate_lsn
* Add some debug logging
2022-02-07 20:05:16 +03:00
Kirill Bulatov
b67cddb303
Implement EphemeralFile flush in a least dangerous way
2022-02-05 22:02:59 -05:00
anastasia
cb1d84d980
Make test_timeline_size_quota more deterministic
2022-02-06 02:16:36 +03:00
anastasia
642797b69e
Implement cluster size quota for zenith compute node.
...
Use GUC zenith.max_cluster_size to set the limit.
If limit is reached, extend requests will throw out-of-space error.
When current size is too close to the limit - throw a warning.
Add new test: test_timeline_size_quota.
2022-02-06 02:16:36 +03:00