mirror of
https://github.com/neondatabase/neon.git
synced 2025-12-23 06:09:59 +00:00
ca9d8761ff
## Problem
We want to move some benchmarks from hetzner runners to aws graviton
runners
## Summary of changes
Adjust the runner labels for some workflows.
Adjust the pagebench number of clients to match the latecny knee at 8
cores of the new instance type
Add `--security-opt seccomp=unconfined` to docker run command to bypass
IO_URING EPERM error.
## New runners
https://us-east-2.console.aws.amazon.com/ec2/home?region=us-east-2#Instances:instanceState=running;search=:github-unit-perf-runner-arm;v=3;$case=tags:true%5C,client:false;$regex=tags:false%5C,client:false;sort=tag:Name
## Important Notes
I added the run-benchmarks label to get this tested **before we merge
it**.
[See](https://github.com/neondatabase/neon/actions/runs/15974141360)
I also test a run of pagebench with the new setup from this branch, see
https://github.com/neondatabase/neon/actions/runs/15972523054
- Update: the benchmarking workflow had failures, [see]
(https://github.com/neondatabase/neon/actions/runs/15974141360/job/45055897591)
- changed docker run command to avoid io_uring EPERM error, new run
[see](https://github.com/neondatabase/neon/actions/runs/15997965633/job/45125689920?pr=12393)
Update: the pagebench test run on the new runner [completed
successfully](https://github.com/neondatabase/neon/actions/runs/15972523054/job/45046772556)
Update 2025-07-07: the latest runs with instance store ext4 have been
successful and resolved the direct I/O issues we have been seeing before
in some runs. We only had one perf testcase failing (shard split) that
had been flaky before. So I think we can merge this now.
## Follow up
if this is merged and works successfully we must create a separate issue
to de-provision the hetzner unit-perf runners defined
[here](91a41729af/ansible/inventory/hosts_metal (L111))
48 lines
1.2 KiB
YAML
48 lines
1.2 KiB
YAML
self-hosted-runner:
|
|
labels:
|
|
- arm64
|
|
- large
|
|
- large-arm64
|
|
- small
|
|
- small-metal
|
|
- small-arm64
|
|
- unit-perf
|
|
- unit-perf-aws-arm
|
|
- us-east-2
|
|
config-variables:
|
|
- AWS_ECR_REGION
|
|
- AZURE_DEV_CLIENT_ID
|
|
- AZURE_DEV_REGISTRY_NAME
|
|
- AZURE_DEV_SUBSCRIPTION_ID
|
|
- AZURE_PROD_CLIENT_ID
|
|
- AZURE_PROD_REGISTRY_NAME
|
|
- AZURE_PROD_SUBSCRIPTION_ID
|
|
- AZURE_TENANT_ID
|
|
- BENCHMARK_INGEST_TARGET_PROJECTID
|
|
- BENCHMARK_LARGE_OLTP_PROJECTID
|
|
- BENCHMARK_PROJECT_ID_PUB
|
|
- BENCHMARK_PROJECT_ID_SUB
|
|
- DEV_AWS_OIDC_ROLE_ARN
|
|
- DEV_AWS_OIDC_ROLE_MANAGE_BENCHMARK_EC2_VMS_ARN
|
|
- HETZNER_CACHE_BUCKET
|
|
- HETZNER_CACHE_ENDPOINT
|
|
- HETZNER_CACHE_REGION
|
|
- NEON_DEV_AWS_ACCOUNT_ID
|
|
- NEON_PROD_AWS_ACCOUNT_ID
|
|
- PGREGRESS_PG16_PROJECT_ID
|
|
- PGREGRESS_PG17_PROJECT_ID
|
|
- REMOTE_STORAGE_AZURE_CONTAINER
|
|
- REMOTE_STORAGE_AZURE_REGION
|
|
- SLACK_CICD_CHANNEL_ID
|
|
- SLACK_COMPUTE_CHANNEL_ID
|
|
- SLACK_ON_CALL_DEVPROD_STREAM
|
|
- SLACK_ON_CALL_QA_STAGING_STREAM
|
|
- SLACK_ON_CALL_STORAGE_STAGING_STREAM
|
|
- SLACK_ONCALL_COMPUTE_GROUP
|
|
- SLACK_ONCALL_PROXY_GROUP
|
|
- SLACK_ONCALL_STORAGE_GROUP
|
|
- SLACK_PROXY_CHANNEL_ID
|
|
- SLACK_RUST_CHANNEL_ID
|
|
- SLACK_STORAGE_CHANNEL_ID
|
|
- SLACK_UPCOMING_RELEASE_CHANNEL_ID
|