Commit Graph

  • 235e357df7 BENCHMARK: Christian Schwarz 2024-03-22 21:38:24 +00:00
  • 8176aca56b DO NOT MERGE: diable materialized page cache for benchmarking Christian Schwarz 2024-03-22 21:27:52 +00:00
  • b546031480 use tokio::signal for pageserver shutdown Christian Schwarz 2024-03-22 20:51:33 +00:00
  • d83eaf7aee fixup: task_mgr::spawn is used in places that don't have ambient runtime Christian Schwarz 2024-03-22 19:49:49 +00:00
  • 9e2a805d88 only one runtime Christian Schwarz 2024-03-22 19:13:54 +01:00
  • 35f4c04c9b Remove Get/SetZenithCurrentClusterSize from Postgres core (#7196) Konstantin Knizhnik 2024-03-22 19:14:31 +02:00
  • 1787cf19e3 pageserver: write consumption metrics to S3 (#7200) John Spray 2024-03-22 14:52:14 +00:00
  • 9fb22c1060 add test case skyzh/test-2-replica-repro Alex Chi Z 2024-03-22 10:18:10 -04:00
  • 2668a1dfab CI: deploy release version to a preprod region (#6811) Alexander Bayandin 2024-03-22 14:42:10 +00:00
  • d41db8c32d Revert "proxy: connect redis with AWS IAM (#7189)" revert-7189-proxy-aws-irsa-auth-for-elasticache Conrad Ludgate 2024-03-22 14:37:59 +00:00
  • 77f3a30440 proxy: unit tests for auth_quirks (#7199) Conrad Ludgate 2024-03-22 13:31:10 +00:00
  • 8265739e91 HACK: restore old impl, make runtime configurable (how to: reconfigure via HTTP, then kill existing walredo procs) problame/async-walredo/benchmarking-2024-03-22--1 Christian Schwarz 2024-03-22 10:23:53 +00:00
  • 62b318c928 Fix ephemeral file warning on secondaries (#7201) John Spray 2024-03-22 10:10:28 +00:00
  • 3aa4fc593e DO NOT MERGE: benchmarking setup Christian Schwarz 2024-03-22 09:53:02 +00:00
  • 6770ddba2e proxy: connect redis with AWS IAM (#7189) Anna Khanova 2024-03-22 09:38:04 +01:00
  • 3ee34a3f26 Update Rust to 1.77.0 (#7198) Arpad Müller 2024-03-22 07:52:31 +01:00
  • 234b69609a Update pgvector to v0.6.0, fourth attempt Heikki Linnakangas 2024-02-17 00:20:00 +02:00
  • 655d3b6468 audit for cancellation-safety Christian Schwarz 2024-03-21 15:38:45 +00:00
  • 3dfc7de99b use chrono::DateTime for Poisoned errors Christian Schwarz 2024-03-21 15:31:24 +00:00
  • 3a5994bb43 Merge branch 'main' into problame/integrate-tokio-epoll-uring/benchmarking/2024-01-31-prs/async-walredo Christian Schwarz 2024-03-21 14:26:05 +00:00
  • fb60278e02 walredo benchmark: throughput-oriented rewrite (#7190) Christian Schwarz 2024-03-21 15:24:56 +01:00
  • d5304337cf proxy: simplify password validation (#7188) Conrad Ludgate 2024-03-21 13:54:06 +00:00
  • 06cb582d91 pageserver: extend /re-attach response to include tenant mode (#6941) John Spray 2024-03-21 13:39:23 +00:00
  • 86b0df973a apply review suggestion https://github.com/neondatabase/neon/pull/7190#discussion_r1533884248 Christian Schwarz 2024-03-21 13:23:08 +00:00
  • e669b6d852 Merge branch 'problame/async-walredo/better-benchmark' into problame/integrate-tokio-epoll-uring/benchmarking/2024-01-31-prs/async-walredo Christian Schwarz 2024-03-21 13:05:06 +00:00
  • b2f5b84c2f cargo fmt Christian Schwarz 2024-03-21 13:00:55 +00:00
  • a21409b509 measure results Christian Schwarz 2024-03-21 12:57:21 +00:00
  • bb47d536fb pageserver: quieten log on shutdown-while-attaching (#7177) John Spray 2024-03-21 12:56:13 +00:00
  • c6a74bd17f Merge branch 'problame/async-walredo/better-benchmark' into problame/integrate-tokio-epoll-uring/benchmarking/2024-01-31-prs/async-walredo Christian Schwarz 2024-03-21 12:31:05 +00:00
  • d6c45625e6 update numbers (the yield makes a big difference, who would have thunken) Christian Schwarz 2024-03-21 12:30:10 +00:00
  • 448de0ba36 f jcsp/s3-dr-test-stability John Spray 2024-03-21 12:18:24 +00:00
  • 59cdee749e storage controller: fixes to secondary location handling (#7169) John Spray 2024-03-21 12:06:57 +00:00
  • c75b584430 storage_controller: add metrics (#7178) Vlad Lazar 2024-03-21 12:00:20 +00:00
  • 123d1f7ca6 wip test John Spray 2024-03-21 11:32:13 +00:00
  • 5ec6862bcf proxy: async aware password validation (#7176) Conrad Ludgate 2024-03-21 10:58:41 +00:00
  • db3333eecb yield after ever redo execution Christian Schwarz 2024-03-21 10:51:42 +00:00
  • 15cfa7b6e9 apply review suggestions Christian Schwarz 2024-03-21 10:51:22 +00:00
  • 94138c1a28 Enforce LSN ordering of batch entries (#7071) Jure Bajic 2024-03-21 10:17:24 +01:00
  • 2206e14c26 fix(layer): remove the need to repair internal state (#7030) rc/proxy/2024-03-21 Joonas Koivunen 2024-03-21 03:19:08 +02:00
  • a95c41f463 fix(heavier_once_cell): take_and_deinit should take ownership (#7185) Joonas Koivunen 2024-03-21 00:42:38 +02:00
  • 041b653a1a Add state diagram for compute Tristan Partin 2024-03-18 15:34:16 -05:00
  • 55c4ef408b safekeeper: correctly handle signals (#7167) Alex Chi Z 2024-03-20 15:22:25 -04:00
  • 5f0d9f2360 fix: add safekeeper team to pgxn codeowners (#7170) Alex Chi Z 2024-03-20 14:40:48 -04:00
  • 34fa34d15c Dump layer map json in test_gc_feedback.py (#7179) Arpad Müller 2024-03-20 19:39:46 +01:00
  • e961e0d3df fix(Layer): always init after downloading in the spawned task (#7175) Joonas Koivunen 2024-03-20 20:37:47 +02:00
  • 8677136bc8 Merge branch 'problame/async-walredo/better-benchmark' into problame/integrate-tokio-epoll-uring/benchmarking/2024-01-31-prs/async-walredo Christian Schwarz 2024-03-20 18:11:28 +00:00
  • a37d713f2b Merge branch 'main' into problame/async-walredo/better-benchmark Christian Schwarz 2024-03-20 18:11:13 +00:00
  • 2726b1934e pageserver: extra debug for test_secondary_downloads failures (#7183) John Spray 2024-03-20 18:07:45 +00:00
  • 081af38076 Merge branch 'main' into problame/async-walredo/better-benchmark Christian Schwarz 2024-03-20 18:06:06 +00:00
  • 929423cf68 add i3en.3xlarge reference numbers Christian Schwarz 2024-03-20 18:04:14 +00:00
  • 3d16cda846 refactor(layer): use detached init (#7152) Joonas Koivunen 2024-03-20 18:03:09 +02:00
  • 48b22bd057 walredo: better benchmark Christian Schwarz 2024-03-20 15:01:14 +00:00
  • 80de8567dc Merge branch 'main' into problame/integrate-tokio-epoll-uring/benchmarking/2024-01-31-prs/async-walredo Christian Schwarz 2024-03-20 14:32:17 +00:00
  • f038304274 minimize diff Christian Schwarz 2024-03-20 14:14:14 +00:00
  • c853c61c11 replace bench_walredo with my impl Christian Schwarz 2024-03-20 14:09:40 +00:00
  • f31f2e9e24 finish benchmark impl (switch to criterion) Christian Schwarz 2024-03-20 14:09:13 +00:00
  • fb66a3dd85 fix: ResidentLayer::load_keys should not create INFO level span (#7174) Joonas Koivunen 2024-03-20 16:08:03 +02:00
  • 6d996427b1 proxy: enable sha2 asm support (#7184) Conrad Ludgate 2024-03-20 12:26:31 +00:00
  • 4ba3f3518e test: fix on demand activation test flakyness (#7180) Vlad Lazar 2024-03-20 10:24:59 +00:00
  • a5d5c2a6a0 storage controller: tech debt (#7165) John Spray 2024-03-19 16:08:20 +00:00
  • 64c6dfd3e4 Move functions for creating/extracting tarballs into utils Tristan Partin 2024-03-14 14:35:34 -05:00
  • a8384a074e fixup(#7168): neon_local: use pageserver defaults for known but unspecified config overrides (#7166) Alex Chi Z 2024-03-19 10:43:24 -04:00
  • 5bad8126dc Merge pull request #7173 from neondatabase/rc/proxy/2024-03-19 release-proxy-5147 Conrad Ludgate 2024-03-19 12:11:42 +00:00
  • 7b860b837c Merge pull request #7154 from neondatabase/rc/2024-03-18 release-5147 Arpad Müller 2024-03-19 12:07:14 +01:00
  • b80704cd34 tests: log hygiene checks for storage controller (#6710) John Spray 2024-03-19 10:30:33 +00:00
  • 49be446d95 async password validation (#7171) Conrad Ludgate 2024-03-18 22:57:32 +00:00
  • ad5efb49ee Support backpressure for sharding (#7100) Arthur Petukhovsky 2024-03-18 22:54:44 +01:00
  • 41fc96e20f fixup(#7160 / tokio_epoll_uring_ext): double-panic caused by info! in thread-local's drop() (#7164) Christian Schwarz 2024-03-18 16:12:01 +01:00
  • 2bc2fd9cfd fixup(#7160 / tokio_epoll_uring_ext): double-panic caused by info! in thread-local's drop() (#7164) Christian Schwarz 2024-03-18 16:12:01 +01:00
  • 877fd14401 fix: spanless log message (#7155) Joonas Koivunen 2024-03-18 16:27:53 +02:00
  • db749914d8 fixup(#7141 / tokio_epoll_uring_ext): high frequency log message (#7160) Christian Schwarz 2024-03-18 13:29:20 +01:00
  • fb2b1ce57b fixup(#7141 / tokio_epoll_uring_ext): high frequency log message Christian Schwarz 2024-03-18 11:47:59 +00:00
  • 1d3ae57f18 pageserver: refactoring in TenantManager to reduce duplication (#6732) John Spray 2024-03-18 10:37:20 +00:00
  • 464717451b build: make procfs linux only dependency (#7156) Joonas Koivunen 2024-03-18 11:28:45 +02:00
  • 30a3d80d2f build: make procfs linux only dependency (#7156) Joonas Koivunen 2024-03-18 11:28:45 +02:00
  • 5cec5cb3cf fixup(#7120): the macOS code used an outdated constant name, broke the build (#7150) Christian Schwarz 2024-03-15 20:48:51 +01:00
  • 0694ee9531 tokio-epoll-uring: retry on launch failures due to locked memory (#7141) Christian Schwarz 2024-03-15 20:46:15 +01:00
  • 9752ad8489 pageserver, controller: improve secondary download APIs for large shards (#7131) John Spray 2024-03-15 19:45:58 +00:00
  • cd6d9abafb WIP: throughput-oriented walredo benchmark Christian Schwarz 2024-03-15 19:20:34 +00:00
  • ad6f538aef tokio-epoll-uring: use it for on-demand downloads (#6992) Christian Schwarz 2024-03-15 19:57:05 +01:00
  • 1aa159acca pageserver: cancellation for remote ops in tenant deletion on shutdown (#6105) John Spray 2024-03-15 18:03:49 +00:00
  • 60f30000ef tokio-epoll-uring: fallback to std-fs if not available & not explicitly requested (#7120) Christian Schwarz 2024-03-15 18:46:04 +01:00
  • bc1efa827f pageserver: exclude gc_horizon from synthetic size calculation (#6407) John Spray 2024-03-15 16:07:36 +00:00
  • 67522ce83d docs: shard splitting RFC (#6358) John Spray 2024-03-15 16:00:04 +00:00
  • 7d32af5ad5 .github: apply timeout to pytest regress (#7142) John Spray 2024-03-15 15:57:01 +00:00
  • 59b6cce418 heavier_once_cell: add detached init support (#7135) Joonas Koivunen 2024-03-15 17:54:28 +02:00
  • bf187aa13f fix(layer): metric miscalculations (#7137) Joonas Koivunen 2024-03-15 17:30:13 +02:00
  • 22c26d610b pageserver: remove un-needed "uninit mark" (#5717) John Spray 2024-03-15 15:23:05 +00:00
  • 516f793ab4 remote_storage: make last_modified and etag mandatory (#7126) John Spray 2024-03-15 13:37:49 +00:00
  • 6443dbef90 tests: extend log allow list for test_sharding_split_failures (#7134) John Spray 2024-03-15 13:18:12 +00:00
  • 23416cc358 docs: sharding phase 1 RFC (#5432) John Spray 2024-03-15 11:14:25 +00:00
  • 46098ea0ea proxy: add more missing warm logging (#7133) Anna Khanova 2024-03-15 16:13:15 +05:00
  • 49bc734e02 proxy: add websocket regression tests (#7121) Conrad Ludgate 2024-03-15 09:21:48 +00:00
  • 70d1086e0f Prepare for first stage of deployment: do not bump format version and do not write data in new format but recognoze new format image_layer_compression Konstantin Knizhnik 2024-03-15 10:02:51 +02:00
  • 76c44dc140 spec: disable neon extension auto upgrade (#7128) Alex Chi Z 2024-03-14 15:45:38 -04:00
  • 58ef78cf41 doc(README): note cargo-nextest usage (#7122) Joonas Koivunen 2024-03-14 20:49:42 +02:00
  • 261f116a2d local benchmark run problame/investigate-slow-test_bulk_insert Christian Schwarz 2024-03-14 17:29:04 +00:00
  • 79a6cda45d page_cache_priming_writer: done Christian Schwarz 2024-03-14 17:15:38 +00:00
  • f0a67c4071 WIP: page_cache_priming_writer: clippy Christian Schwarz 2024-03-14 17:19:15 +00:00
  • a1f4eb2815 WIP: page_cache_priming_writer: bugfixes Christian Schwarz 2024-03-14 17:15:03 +00:00