Commit Graph

  • 6e40900569 Manage pgbouncer configuration from compute_ctl: - add pgbouncer_settings section to compute spec; - add pgbouncer-connstr option to compute_ctl. - add pgbouncer-ini-path option to compute_ctl. Default: /etc/pgbouncer/pgbouncer.ini Anastasia Lubennikova 2023-12-14 15:08:14 +00:00
  • ddc431fc8f pgindent walproposer condvar comment Arseny Sher 2023-12-26 12:03:42 +03:00
  • bfc98f36e3 Refactor handling responses in walproposer. Arseny Sher 2023-12-16 00:00:49 +03:00
  • d5fbfe2399 Remove test_wal_deleted_after_broadcast. Arseny Sher 2023-12-15 16:02:42 +03:00
  • 1f1c50e8c7 Don't re-add neon_walreader socket to waiteventset if possible. Arseny Sher 2023-12-15 11:25:44 +03:00
  • 854df0f566 Do PQgetCopyData before PQconsumeInput in libpqwp_async_read. Arseny Sher 2023-12-14 17:40:42 +03:00
  • 9c493869c7 Perform synchronous WAL download in wp only for logical replication. Arseny Sher 2023-12-14 17:08:36 +03:00
  • df760e6de5 Add test_lagging_sk. Arseny Sher 2023-12-06 10:12:19 +03:00
  • 14913c6443 Adapt rust walproposer to neon_walreader. Arseny Sher 2023-12-08 18:05:48 +03:00
  • cdb08f0362 Introduce NeonWALReader downloading sk -> compute WAL on demand. Arseny Sher 2023-10-23 17:05:41 +03:00
  • 22e9702525 migrate script sk-migrate-script Arseny Sher 2023-12-25 23:04:34 +03:00
  • 572bc06011 Do not copy WAL for lagged slots (#6221) Konstantin Knizhnik 2023-12-22 20:47:55 +02:00
  • 3f1e5b38d8 DNM demo jcsp/attachment-service-v2 John Spray 2023-12-22 18:11:37 +00:00
  • 56fddf1ea6 f John Spray 2023-12-22 16:21:55 +00:00
  • 2a13306c71 DNM demo scripts John Spray 2023-12-22 15:32:50 +00:00
  • 54386a537d f dirty hacks John Spray 2023-12-22 15:32:21 +00:00
  • b4b5d20ddc DNM control_plane: pinning for John's workstation John Spray 2023-12-22 15:31:57 +00:00
  • fa058efa58 pageserver: only upload initdb from shard 0 John Spray 2023-12-22 14:04:08 +00:00
  • cd1e438169 demo snapshot John Spray 2023-12-22 13:58:29 +00:00
  • f67080410f f status command John Spray 2023-12-22 13:58:22 +00:00
  • 82ccd449d7 pageserver: fix active tenant lookup hitting secondaries with sharding John Spray 2023-12-22 13:58:00 +00:00
  • d4c4ee6a14 f DNM demo John Spray 2023-12-22 13:40:22 +00:00
  • 758bb24445 DNM dirty hacks John Spray 2023-12-22 13:40:04 +00:00
  • ed11fc0ec8 DNM: hack small buffer size into compute John Spray 2023-12-22 13:39:48 +00:00
  • a7342b3897 remote_storage: store last_modified and etag in Download (#6227) Arpad Müller 2023-12-22 14:13:20 +01:00
  • b8fad41fbe Cap WAL download for LR on compute start by max_slot_wal_keep_size. lr-cap-wal-download Arseny Sher 2023-12-22 15:42:34 +03:00
  • 61044aa7f0 DNM demo script John Spray 2023-12-22 11:53:20 +00:00
  • 35de775ed5 pageserver: log details on shard routing error John Spray 2023-12-22 11:52:09 +00:00
  • 95505e5ac1 neon_local: add shard split command John Spray 2023-12-22 11:01:53 +00:00
  • dda046bbcd pageserver: don't delete ancestor shard layers John Spray 2023-12-22 10:12:34 +00:00
  • 7b2019fdfe fixup! compute_tools: enable passing through stripe size John Spray 2023-12-21 17:31:20 +00:00
  • b57848236f pgxn: fix stripe calculation John Spray 2023-12-22 11:53:09 +00:00
  • e68ae2888a pageserver: expedite tenant activation on delete (#6190) John Spray 2023-12-22 10:22:22 +00:00
  • 218a8a7461 Support sharding at compute side Konstantin Knizhnik 2023-12-20 21:04:14 +02:00
  • e745391c72 f neon_local reconfigure John Spray 2023-12-20 13:01:01 +00:00
  • 6e56f88b79 control_plane: improve debug of pageserver_connstr John Spray 2023-12-19 11:05:58 +00:00
  • 3ccf5abc9d control plane: improve handling of stripe size John Spray 2023-12-12 15:07:01 +00:00
  • bc90272e47 tests: support initial stream size + migration John Spray 2023-12-21 17:08:11 +00:00
  • aa1252d687 compute_tools: enable passing through stripe size John Spray 2023-12-18 19:52:16 +00:00
  • 727eef05b3 tests: make more fixtures/helpers shard-aware John Spray 2023-12-18 19:43:10 +00:00
  • a5813e2516 tests: add test_sharding_smoke John Spray 2023-12-18 19:42:06 +00:00
  • 3c1d8e7239 tests: enable using timeout with CLIs John Spray 2023-12-20 12:47:48 +00:00
  • 3835a51429 control_plane: rebase fixes John Spray 2023-12-18 14:54:59 +00:00
  • 495c3d70f3 clippy John Spray 2023-12-12 17:14:43 +00:00
  • d1af9d480e tests: enable s3 scrubber in pg_regress tests John Spray 2023-12-12 16:54:11 +00:00
  • 14b0acbda7 neon_local: improved timeline creation and 'branch' John Spray 2023-12-12 16:28:58 +00:00
  • 583375e6f6 tests: use sharding in test_pageserver_chaos John Spray 2023-12-12 16:28:28 +00:00
  • 1e542b3187 neon_local: always get endpoint pageserver from attachment service John Spray 2023-12-12 15:23:13 +00:00
  • 37db221a60 tests: enable sharding for tests in test_pg_regress.py John Spray 2023-12-12 15:07:16 +00:00
  • 9055985d72 tests: adapt helpers for sharding John Spray 2023-12-12 14:39:37 +00:00
  • fc2f9fa3fe pageserver: implement shard splitting John Spray 2023-12-08 12:56:44 +00:00
  • 9cd72caabf neon_local: add tenant status command John Spray 2023-12-08 11:44:56 +00:00
  • 83000b3824 buildtools: update protoc and mold (#6222) Arpad Müller 2023-12-21 18:07:21 +01:00
  • d1a0a0941a neon_local: add stripe size arg John Spray 2023-12-08 10:23:40 +00:00
  • 347bd012b3 neon_local: attachment service status, refactors John Spray 2023-12-08 10:09:19 +00:00
  • 58f64339f3 neon_local: implement Locate API for attachment service John Spray 2023-12-08 09:20:08 +00:00
  • 78e673fbb3 neon_local: use attachment service to locate pagservers for endpoints John Spray 2023-12-08 09:19:51 +00:00
  • 3d573be816 neon_local: use attachment service for tenant creation John Spray 2023-12-07 16:52:33 +00:00
  • bdc4a7512b pageserver: refactor creation API (add ShardParams) John Spray 2023-12-07 14:57:15 +00:00
  • 24d0395f66 neon_local: update various TenantId uses to TenantShardId John Spray 2023-12-07 14:24:04 +00:00
  • 7bbfc160aa DNM: script for sharding demo John Spray 2023-11-29 15:58:23 +00:00
  • a21b719770 Use neon-github-ci-tests S3 bucket for remote_storage tests (#6216) Arpad Müller 2023-12-21 17:28:28 +01:00
  • 1dff98be84 CI: fix build-tools image tag for PRs (#6217) Alexander Bayandin 2023-12-21 14:55:24 +00:00
  • 7d6fc3c826 Use pre-generated initdb.tar.zst in test_ingest_real_wal (#6206) Arpad Müller 2023-12-21 15:23:09 +01:00
  • e0aa2e2244 last_tenant_id for measuring progress 2023-12-21-scrubber_usage Joonas Koivunen 2023-12-21 13:23:39 +00:00
  • 3432805e25 work around the histogram limitations Joonas Koivunen 2023-12-15 22:27:55 +00:00
  • 2c23ed4873 scan_metadata: rewrite main loop with progress (compile fail) Joonas Koivunen 2023-12-15 21:45:29 +00:00
  • a8f7398518 ttid: make fields pub Joonas Koivunen 2023-12-15 21:44:44 +00:00
  • 9684fb2ba5 silence needless warning Joonas Koivunen 2023-12-15 22:35:49 +00:00
  • 3ae40556f8 fix: do not use stream for listing timelines Joonas Koivunen 2023-12-15 21:45:09 +00:00
  • 22a7b68b23 fix some of the logging Joonas Koivunen 2023-12-15 21:44:27 +00:00
  • e98c48322d feat: run specific tenants only Joonas Koivunen 2023-12-15 22:26:13 +00:00
  • 61b6c4cf30 Build dockerfile from neon repo (#6195) Abhijeet Patil 2023-12-21 12:46:51 +00:00
  • f93d15f781 add comment to run vacuum for clickbench (#6212) Bodobolero 2023-12-21 13:34:31 +01:00
  • 1a8a46bab4 test_pageserver: make compatible with the latest code Alexander Bayandin 2023-12-20 19:53:34 +00:00
  • 79917e1889 test_pageserver: add snapshotting_env fixture Alexander Bayandin 2023-12-14 17:49:00 +00:00
  • 69ec51d3c4 Add NeonBenchmarker#record_pagebench_results method Alexander Bayandin 2023-12-20 13:28:57 +00:00
  • 601072db26 python script to duplicate tenants Christian Schwarz 2023-12-18 18:19:25 +00:00
  • 8d4fc911c1 WIP: performance test that uses the getpage benchmark Christian Schwarz 2023-11-09 15:58:16 +00:00
  • 5385791ca6 add pageserver component-level benchmark (pagebench) (#6174) Christian Schwarz 2023-12-21 13:07:23 +01:00
  • 2df3602a4b Add GC to http connection pool (#6196) Conrad Ludgate 2023-12-21 12:00:10 +00:00
  • 48890d206e Simplify inject_index_part test function (#6207) Arpad Müller 2023-12-21 12:52:38 +01:00
  • baa1323b4a Use ProfileFileCredentialsProvider for AWS SDK configuration (#6202) Arpad Müller 2023-12-20 23:38:58 +01:00
  • 45bd85c372 pageserver: skip the blk range check: this is slow (reads relsize page) if queries aren't hitting latest=true John Spray 2023-12-20 20:06:56 +00:00
  • 403aff42d7 timeline: skip materialized page cache for relation blocks John Spray 2023-12-20 20:06:46 +00:00
  • fa113f8d40 page_cache: don't use a histogram (too expensive) John Spray 2023-12-20 20:05:06 +00:00
  • 8ec1b57a2c pagebench: hack around bug John Spray 2023-12-20 20:03:23 +00:00
  • d1bcecebde test_pageserver: make compatible with the latest code problame/benchmarking/2023-12-20--1 Alexander Bayandin 2023-12-20 19:53:34 +00:00
  • a8ec7d7ad8 pageserver: prototype of skipping page cache for non-index block reads John Spray 2023-12-20 19:18:26 +00:00
  • 48f156b8a2 feat: relative last activity based eviction (#6136) Joonas Koivunen 2023-12-20 20:44:19 +02:00
  • e49f2d72af test_pageserver: add snapshotting_env fixture Alexander Bayandin 2023-12-14 17:49:00 +00:00
  • c3ab86dc6a Add NeonBenchmarker#record_pagebench_results method Alexander Bayandin 2023-12-20 13:28:57 +00:00
  • fdfa9d2c9a bump recursion limit, as suggested by compiler error Christian Schwarz 2023-12-20 17:24:10 +00:00
  • 743d2e54a4 Merge remote-tracking branch 'origin/main' into problame/integrate-tokio-epoll-uring/wip Christian Schwarz 2023-12-20 17:21:59 +00:00
  • 48e058da3f tokio-epoll-uring: make io engine configurable (#6118) Christian Schwarz 2023-12-20 18:12:26 +01:00
  • ac38d3a88c remote_storage: don't count 404s as errors (#6201) John Spray 2023-12-20 17:00:29 +00:00
  • 163083665e python script to duplicate tenants Christian Schwarz 2023-12-18 18:19:25 +00:00
  • 8dcf78d1af WIP: performance test that uses the getpage benchmark Christian Schwarz 2023-11-09 15:58:16 +00:00
  • fab67eed59 Update pageserver/src/tenant/secondary/heatmap_uploader.rs jcsp/secondary-downloads-eviction John Spray 2023-12-20 16:10:59 +00:00
  • a57116e92b Update pageserver/src/tenant/secondary/downloader.rs John Spray 2023-12-20 16:09:05 +00:00