Commit Graph

  • 9132d80aa3 add pgcopydb tool to build tools image (#9658) Peter Bendel 2024-11-07 19:00:25 +01:00
  • 82e3f0ecba [proxy/authorize]: improve JWKS reliability (#9676) Conrad Ludgate 2024-11-07 16:24:38 +00:00
  • 75aa19aa2d Don't attach is_archived to debug output (#9679) Arpad Müller 2024-11-07 17:13:50 +01:00
  • a8d9939ea9 fix(pageserver): reduce aux compaction threshold (#9647) Alex Chi Z. 2024-11-07 10:38:15 -05:00
  • ab34e34ba9 Merge branch 'main' into erik/durable-rename-fsync-metrics erik/durable-rename-fsync-metrics Erik Grinaker 2024-11-07 16:20:38 +01:00
  • f18aa04b90 safekeeper: use set_len() to zero out segments (#9665) Erik Grinaker 2024-11-07 16:09:57 +01:00
  • 55157b3506 test pgcopydb with new build-tools image BodoBolero 2024-11-07 16:06:15 +01:00
  • d6ab04b8e2 safekeeper: record fsync metrics for segment renames Erik Grinaker 2024-11-07 16:02:06 +01:00
  • 31d87720d7 undo changes to Dockerfile - these changes are in separate PR BodoBolero 2024-11-07 16:01:43 +01:00
  • 01265b7bc6 safekeeper: add basic WAL ingestion benchmarks (#9531) Erik Grinaker 2024-11-07 14:24:03 +01:00
  • f54f0e8e2d Fix direct reading from WAL buffers. (#9639) Arseny Sher 2024-11-07 14:29:52 +03:00
  • d6aa26a533 postgres_ffi: make WalGenerator generic over record generator (#9614) Erik Grinaker 2024-11-07 11:38:39 +01:00
  • f5eec194e7 Merge pull request #9674 from neondatabase/rc/proxy/2024-11-07 release-proxy-6792 Ivan Efremov 2024-11-07 12:07:12 +02:00
  • e1d0b73824 chore(compute): Bump pg_mooncake to the latest version Cheng Chen 2024-11-06 20:41:18 -08:00
  • 011c0a175f Support copying layers in detach_ancestor from before shard splits (#9669) Arpad Müller 2024-11-07 01:53:58 +01:00
  • 2a95a51a0d refactor(pageserver): better pageservice command parsing (#9597) Alex Chi Z. 2024-11-06 15:41:01 -05:00
  • 11fc1a4c12 fix(test): use layer map dump in test_readonly_node_gc to validate layers protected by leases (#9551) Yuchen Liang 2024-11-06 15:18:21 -05:00
  • 93123f2623 Rename compute_backpressure_throttling_ms to compute_backpressure_throttling_seconds Tristan Partin 2024-11-06 13:28:23 -06:00
  • b3ef315041 more wip vlad/safekeeper-filter-wal Vlad Lazar 2024-11-06 19:41:22 +01:00
  • 1d3559d4bc feat(pageserver): add fast path for sparse keyspace read (#9631) Alex Chi Z. 2024-11-06 13:17:02 -05:00
  • 73bdc9a2d0 [proxy]: minor changes to endpoint-cache handling (#9666) Conrad Ludgate 2024-11-06 17:40:40 +00:00
  • d182ff294c storcon: respect tenant scheduling policy in drain/fill (#9657) John Spray 2024-11-06 15:14:43 +00:00
  • f0044b8651 wip Vlad Lazar 2024-11-06 16:11:50 +01:00
  • b7ff993df6 wal_decoder: make InterpretedWalRecord serde Vlad Lazar 2024-11-05 19:18:06 +01:00
  • 5d096f127e safekeeper: parse new connection configs Vlad Lazar 2024-11-05 17:35:11 +01:00
  • 70cdd56294 pageserver: include shard id when subscribing to safekeeper Vlad Lazar 2024-11-05 17:08:06 +01:00
  • 4dfa0c221b pageserver: ingest pre-serialized batches of values (#9579) Vlad Lazar 2024-11-06 14:10:32 +00:00
  • bdd492b1d8 proxy: Replace "web(auth)" with "console redirect" everywhere (#9655) Folke Behrens 2024-11-06 12:03:38 +01:00
  • 5d8284c7fe proxy: Read cplane JWT with clap arg (#9654) Folke Behrens 2024-11-06 11:27:55 +01:00
  • d33619f2b6 use newer image with pgcopydb 0.17-1 and verify it can be invoked BodoBolero 2024-11-06 10:47:47 +01:00
  • 0799fd6fca need higher version of pgcopydb BodoBolero 2024-11-06 10:35:26 +01:00
  • 0e524c969b fix image build errors BodoBolero 2024-11-06 09:20:27 +01:00
  • 57752a0188 pgcopydb package only available for bookworm BodoBolero 2024-11-06 09:12:43 +01:00
  • ebc43efebc proxy: Refactor cplane types (#9643) Folke Behrens 2024-11-05 23:03:53 +01:00
  • 754d2950a3 proxy: Revert ControlPlaneEvent back to struct (#9649) Folke Behrens 2024-11-05 22:32:33 +01:00
  • 500206ad0f Increase verbosity of invalid compute status logs tristan957/compute-status Tristan Partin 2024-11-05 14:10:03 -06:00
  • fcde40d600 [proxy] use the proxy protocol v2 command to silence some logs (#9620) Conrad Ludgate 2024-11-05 17:23:00 +00:00
  • 6d675196bf try to add pgcopydb to build-tools BodoBolero 2024-11-05 18:19:54 +01:00
  • babfeb70ba safekeeper: don't allocate send buffers on stack (#9644) Erik Grinaker 2024-11-05 18:05:30 +01:00
  • 35a594b91e Update pageserver/src/tenant/remote_timeline_client.rs skyzh/barrier-process Alex Chi Z. 2024-11-05 12:01:07 -05:00
  • 3e62b34279 Update pageserver/src/tenant/remote_timeline_client.rs Alex Chi Z. 2024-11-05 12:01:02 -05:00
  • 8e87dcc3d6 reduce token lifetime BodoBolero 2024-11-05 17:57:07 +01:00
  • 6d724178d3 need to download our own actions to use them BodoBolero 2024-11-05 17:52:42 +01:00
  • 4f9c6043ea need permissions to use AWS credentials BodoBolero 2024-11-05 17:47:54 +01:00
  • f1573962b8 don't need prepare databases for ingest bench BodoBolero 2024-11-05 17:44:23 +01:00
  • 8ac210247c need AWS credentials to download Neon BodoBolero 2024-11-05 17:41:14 +01:00
  • 3ceb9f8ec9 fix(pageserver): barrier should wait for deletions Alex Chi Z 2024-11-05 11:38:18 -05:00
  • 31c1af47b7 preparations for ingest benchmarking workflow - install pgcopydb into github runner BodoBolero 2024-11-05 17:37:17 +01:00
  • 2f1a56c8f9 proxy: Unify local and remote conn pool client structures (#9604) Ivan Efremov 2024-11-05 17:33:41 +02:00
  • e30f5fb922 scrubber: remove AWS region assumption, tolerate negative max_project_size (#9636) John Spray 2024-11-05 13:32:50 +00:00
  • 70ae8c16da Construct models::TenantConfig only once (#9630) Arpad Müller 2024-11-05 14:02:49 +01:00
  • 8840f3858c pageserver: return 503 during tenant shutdown (#9635) Erik Grinaker 2024-11-05 13:16:55 +01:00
  • 1e16221f82 Update psycopg2 to latest version for complete PG 17 support Tristan Partin 2024-11-04 18:21:59 -06:00
  • 34812a6aab Improve some typing related to performance testing for LR Tristan Partin 2024-11-04 15:52:01 -06:00
  • ee68bbf6f5 Add tenant config option to allow timeline_offloading (#9598) Arpad Müller 2024-11-04 21:01:18 +01:00
  • 1085fe57d3 proxy: Rewrite ControlPlaneEvent as enum (#9627) Folke Behrens 2024-11-04 20:19:26 +01:00
  • 59879985b4 proxy: Wrap JWT errors in separate AuthError variant (#9625) Folke Behrens 2024-11-04 19:56:40 +01:00
  • 81d1bb1941 quieten aws_config logs (#9626) Conrad Ludgate 2024-11-04 17:28:10 +00:00
  • 8e4161eb94 Merge pull request #9617 from neondatabase/rc/2024-11-04 release-7044 Arpad Müller 2024-11-04 17:50:29 +01:00
  • 06113e94e6 fix(test_regress): always use storcon virtual pageserver API to set tenant config (#9622) Christian Schwarz 2024-11-04 17:42:08 +01:00
  • 0d5a512825 safekeeper: add walreceiver metrics (#9450) Erik Grinaker 2024-11-04 16:22:46 +01:00
  • 8ad1dbce72 [proxy]: parse proxy protocol TLVs with aws/azure support (#9610) Conrad Ludgate 2024-11-04 14:04:56 +00:00
  • dba696885d review: do some testing of parallel IO Vlad Lazar 2024-11-04 14:42:49 +01:00
  • 3dcdbcc34d remove aws-lc-rs dep and fix storage_broker tls (#9613) Conrad Ludgate 2024-11-04 13:29:13 +00:00
  • 657526a5be review: make import scope tighter Vlad Lazar 2024-11-04 14:24:30 +01:00
  • 2508c64646 review: comment on end state of io concurrency Vlad Lazar 2024-11-04 14:14:21 +01:00
  • 34a43b0789 review: improve doc comment for planner Vlad Lazar 2024-11-04 14:12:44 +01:00
  • 9f95864c8a review: remove matches! usage Vlad Lazar 2024-11-04 14:08:26 +01:00
  • bea8269a17 zerocopy parsing zerocopy-proxyprotocol2-parsing Conrad Ludgate 2024-11-04 13:07:27 +00:00
  • c446e3d3ab chore: fixup comment Vlad Lazar 2024-10-10 20:40:34 +02:00
  • 6599034410 chore: clippy warn Vlad Lazar 2024-10-10 20:34:28 +02:00
  • eafae92795 pageserver: make io serial by default Vlad Lazar 2024-10-10 20:30:17 +02:00
  • 1cbbc35957 pageserver: fixup some tests using low level read apis Vlad Lazar 2024-10-10 20:10:15 +02:00
  • cc57b34771 pageserver: reinstate inspect_image_layers Vlad Lazar 2024-10-10 20:08:51 +02:00
  • 6da0b5fac1 pagserver: further simplify read path error handling Vlad Lazar 2024-10-10 19:54:51 +02:00
  • 11990ef2fe pageserver: use correct will_init for streaming planner Vlad Lazar 2024-10-10 19:43:12 +02:00
  • 0a840fbdbd pageserver: purge read path caching support Vlad Lazar 2024-10-10 19:28:01 +02:00
  • 0ad736e2a6 pageserver: clean up comms between pending IOs and awaiter Vlad Lazar 2024-10-10 19:11:01 +02:00
  • bde1694cb9 pageserver: remove unused on_key_error method Vlad Lazar 2024-10-10 18:15:27 +02:00
  • e3aa85d722 pagserver: do concurrent IO on the read path Vlad Lazar 2024-10-10 17:51:04 +02:00
  • 444d812220 safekeeper: add InterpretedWalRecord protocol support erik/safekeeper-wal-protocol Erik Grinaker 2024-11-04 13:25:36 +01:00
  • d5de63c6b8 Fix a time zone issue in a PG17 test case (#9618) Matthias van de Meent 2024-11-04 13:10:32 +01:00
  • 3500a758af parse ip addr for consistency Conrad Ludgate 2024-11-04 11:19:36 +00:00
  • 4534f5cdc6 pageserver: make local timeline deletion infallible (#9594) John Spray 2024-11-04 09:11:52 +00:00
  • df58da66d2 safekeeper: add pprof profiling for benchmarks erik/criterion-profile Erik Grinaker 2024-11-03 17:51:46 +01:00
  • f4b8795cf8 Add WalAcceptor throughput benchmark Erik Grinaker 2024-11-03 17:24:28 +01:00
  • 45fe1236ab Move itertools to dev-dependencies Erik Grinaker 2024-11-03 15:42:00 +01:00
  • 6eaf9b9a48 safekeeper: add basic WAL ingestion benchmarks Erik Grinaker 2024-10-26 14:10:39 +02:00
  • 270a9dd91f postgres_ffi: make WalGenerator generic over record generator Erik Grinaker 2024-11-03 15:26:21 +01:00
  • 0058eb09df test_runner/performance: add sharded ingest benchmark (#9591) Erik Grinaker 2024-11-02 17:42:10 +01:00
  • 8ac523d2ee Do not assign page LSN to new (uninitialized) page in ClearVisibilityMapFlags redo handler (#9287) Konstantin Knizhnik 2024-11-01 20:31:29 +02:00
  • 3b3c2da57f [proxy]: parse proxy protocol TLVs with aws/azure support Conrad Ludgate 2024-11-01 18:11:08 +00:00
  • 3c16bd6e0b storcon: skip non-active projects in chaos injection (#9606) John Spray 2024-11-01 16:47:20 +00:00
  • 123816e99a safekeeper: log slow WalAcceptor sends (#9564) Erik Grinaker 2024-11-01 13:47:03 +01:00
  • 8b3bcf71ee revert higher token expiration (#9605) Peter Bendel 2024-11-01 12:46:02 +01:00
  • 4c2c8d6708 test_runner: fix tenant_get_shards with one pageserver (#9603) Erik Grinaker 2024-11-01 12:25:04 +01:00
  • 2d1366c8ee fix pre-commit hook with python stubs (#9602) Conrad Ludgate 2024-11-01 11:22:38 +00:00
  • e589c2e5ec storage_controller: allow deployment infra to use infra token (#9596) Vlad Lazar 2024-10-31 18:29:16 +00:00
  • fd5aa06e28 wal_decoder: add a comment to clarify the intention vlad/log-on-unexpected-pg-record Vlad Lazar 2024-10-31 18:14:33 +01:00
  • 1cdebae470 wal_decoder: no-op on RM_BTREE_ID Vlad Lazar 2024-10-31 18:01:09 +01:00