neon/test_runner/performance/pageserver at 3029c65541648b7bff94de206ebdc20d71411d08 - neon

rust/neon

mirror of https://github.com/neondatabase/neon.git synced 2026-08-18 20:18:23 +00:00

Files

T

Peter Bendel 9ba9f32dfe Reactivate page bench test in CI after ignoring CopyFail error in pageserver (#8023 )

## Problem

Testcase page bench test_pageserver_max_throughput_getpage_at_latest_lsn
had been deactivated because it was flaky.

We now ignore copy fail error messages like in


https://github.com/neondatabase/neon/blob/270d3be507643f068120b52838c497f6c1b45b61/test_runner/regress/test_pageserver_getpage_throttle.py#L17-L20

and want to reactivate it to see it it is still flaky

## Summary of changes

- reactivate the test in CI
- ignore CopyFail error message during page bench test cases

## Checklist before requesting a review

- [ ] I have performed a self-review of my code.
- [ ] If it is a core feature, I have added thorough tests.
- [ ] Do we need to implement analytics? if so did you add the relevant
metrics to the dashboard?
- [ ] If this PR requires public announcement, mark it with
/release-notes label and add several sentences in this section.

## Checklist before merging

- [ ] Do not forget to reformat commit message to not include the above
checklist

2024-06-12 16:10:57 +02:00

interactive

tests/neon_local: rename "attachment service" -> "storage controller" (#7087 )

2024-03-12 11:36:27 +00:00

pagebench

Reactivate page bench test in CI after ignoring CopyFail error in pageserver (#8023 )

2024-06-12 16:10:57 +02:00

__init__.py

pagebench-based GetPage@LSN performance test (#6214 )

2024-01-24 12:51:53 +01:00

README.md

pagebench-based GetPage@LSN performance test (#6214 )

2024-01-24 12:51:53 +01:00

util.py

python: allow using allowed_errors.py (#7719 )

2024-05-13 15:16:23 +03:00

README.md

How to reproduce benchmark results / run these benchmarks interactively.

Get an EC2 instance with Instance Store. Use the same instance type as used for the benchmark run.
Mount the Instance Store => neon.git/scripts/ps_ec2_setup_instance_store
Use a pytest command line (see other READMEs further up in the pytest hierarchy).

For tests that take a long time to set up / consume a lot of storage space, we use the test suite's repo_dir snapshotting functionality (from_repo_dir). It supports mounting snapshots using overlayfs, which improves iteration time.

Here's a full command line.

RUST_BACKTRACE=1 NEON_ENV_BUILDER_USE_OVERLAYFS_FOR_SNAPSHOTS=1 DEFAULT_PG_VERSION=15 BUILD_TYPE=release \
    ./scripts/pytest test_runner/performance/pageserver/pagebench/test_pageserver_max_throughput_getpage_at_latest_lsn.py