Alexander Bayandin c72cb44213 test_runner/performance: parametrize benchmarks (#6744) ...

## Problem
Currently, we don't store `PLATFORM` for Nightly Benchmarks. It
causes them to be merged as reruns in Allure report (because they have
the same test name).

## Summary of changes
- Parametrize benchmarks by 
  - Postgres Version (14/15/16)
  - Build Type (debug/release/remote)
  - PLATFORM (neon-staging/github-actions-selfhosted/...)

---------

Co-authored-by: Bodobolero <peterbendel@neon.tech>

2024-02-15 15:53:58 +00:00

..

pageserver

Pass timestamp as a datetime (#6656)

2024-02-07 12:56:53 +01:00

__init__.py

add pytest integration tests

2021-05-03 11:31:32 -07:00

benchmark_fixture.py

zenbenchmark: attach perf results to allure report (#6395)

2024-01-18 20:59:43 +00:00

broker.py

refactor(NeonEnv): shutdown of child processes (#6327)

2024-01-12 10:23:21 +01:00

compare_fixtures.py

tests: Default to LOCAL_FS for pageserver remote storage (#5402)

2023-09-28 12:25:20 +03:00

flaky.py

test_runner: workaround rerunfailures and timeout incompatibility (#4469)

2023-06-16 18:08:11 +01:00

httpserver.py

refactor: globals in tests (#5298)

2023-09-13 22:05:30 +03:00

log_helper.py

test_runner: pass password to pgbench via PGPASSWORD (#2468)

2022-09-23 12:51:33 +00:00

metrics.py

Create new metric for directory counts (#6736)

2024-02-14 02:12:00 +01:00

neon_fixtures.py

Revert #6666 "tests: try to make restored-datadir comparison tests not flaky" (#6751)

2024-02-14 10:57:01 +00:00

overlayfs.py

python tests: support overlayfs for NeonEnvBuilder.from_repo_dir (#6295)

2024-01-09 10:15:46 +00:00

parametrize.py

test_runner/performance: parametrize benchmarks (#6744)

2024-02-15 15:53:58 +00:00

pg_stats.py

Stricter mypy linters for test_runner/fixtures/*

2022-11-10 12:47:27 +01:00

pg_version.py

tests: support for running on single pg version, use in one place (#6525)

2024-01-31 17:37:25 +02:00

port_distributor.py

tests: split neon_fixtures.py (#4871)

2023-08-03 17:20:24 +03:00

remote_storage.py

Don't require AWS access keys for S3 pytests (#6556)

2024-02-01 20:18:07 +00:00

slow.py

Stricter mypy linters for test_runner/fixtures/*

2022-11-10 12:47:27 +01:00

types.py

pageserver: fixes + test updates for sharding (#6186)

2023-12-20 12:26:20 +00:00

utils.py

pagebench-based GetPage@LSN performance test (#6214)

2024-01-24 12:51:53 +01:00

workload.py

tests: add basic coverage for sharding (#6380)

2024-01-26 14:40:47 +00:00