Commit Graph

  • eb1ccd7988 WIP: page_cache_priming_writer: plumb through RequestContext for previous commit, yet more churn -,- Christian Schwarz 2024-03-14 16:06:04 +00:00
  • 678ed39de2 storage controller: validate DNS of registering nodes (#7101) John Spray 2024-03-14 16:48:38 +00:00
  • 3d8830ac35 test_runner: re-enable large slru benchmark (#7125) Vlad Lazar 2024-03-14 16:47:32 +00:00
  • 5a8e8baf9f Make ruff happy Konstantin Knizhnik 2024-03-14 18:05:30 +02:00
  • f1f0452722 WIP: page_cache_priming_writer (is it really worth it?) Christian Schwarz 2024-03-14 15:46:41 +00:00
  • 38767ace68 storage_controller: periodic pageserver heartbeats (#7092) Vlad Lazar 2024-03-14 15:21:36 +00:00
  • 5fbaa3fd78 Remove LR files from basebackup when preparing standby. lr-rm-files-on-standby Arseny Sher 2024-03-14 17:47:47 +03:00
  • 57a4119a7b Add test for compression Konstantin Knizhnik 2024-03-14 16:45:45 +02:00
  • 9fe0193e51 Bump vendor/postgres v15 v14. Arseny Sher 2024-03-14 07:14:53 +03:00
  • 864f6cf50d libs: fix expired token in auth decode test (#6963) skyzh/release-4917-patched Vlad Lazar 2024-02-29 13:55:38 +00:00
  • aaef3789b0 Ignore format version when comparing summary for delta_layer Konstantin Knizhnik 2024-03-14 14:21:35 +02:00
  • 40200b7521 figure out why & when exactly zeroes past write offset are required & assert it Christian Schwarz 2024-03-14 12:04:17 +00:00
  • 8075f0965a fix(test suite) virtual_file_io_engine and get_vectored_impl patametrization doesn't work (#7113) Christian Schwarz 2024-03-14 12:18:55 +01:00
  • 27bc242085 Merge pull request #7119 from neondatabase/rc/proxy/2024-03-14 release-proxy-5115 Anna Khanova 2024-03-14 14:57:05 +05:00
  • 192b49cc6d Merge branch 'release-proxy' into rc/proxy/2024-03-14 Anna Khanova 2024-03-14 14:16:36 +05:00
  • 44f42627dd pageserver/controller: error handling for shard splitting (#7074) John Spray 2024-03-14 09:11:57 +00:00
  • 3bd6551b36 proxy http cancellation safety (#7117) Conrad Ludgate 2024-03-14 08:20:56 +00:00
  • 0b57e0b8f2 Fix image layer format version matching Konstantin Knizhnik 2024-03-13 21:10:12 +02:00
  • 485ecbaf8f Fix test_attach_tenant_config.py test Konstantin Knizhnik 2024-03-13 18:43:27 +02:00
  • 0bcbce197a Fix test_attach_tenent_config.py test Konstantin Knizhnik 2024-03-13 15:55:44 +02:00
  • 19d59e58d2 Use CompressionAlgorithm enum Konstantin Knizhnik 2024-03-13 15:52:38 +02:00
  • ce65d13dbd Add compress_image_layer to openapi spec Konstantin Knizhnik 2024-03-12 21:31:09 +02:00
  • 18fefff026 Fix compressed blob writer Konstantin Knizhnik 2024-03-12 20:57:18 +02:00
  • 2a69861896 Fix parse_tenant_config test Konstantin Knizhnik 2024-03-12 17:35:15 +02:00
  • 98375b3896 Support vectored comp[ressed blobs read Konstantin Knizhnik 2024-03-12 10:32:49 +02:00
  • 8c60359ae5 Emable iomage layer compression by default Konstantin Knizhnik 2024-03-12 07:58:57 +02:00
  • 8c7136b057 Add compress_image_layer property to TenantConfig Konstantin Knizhnik 2024-03-11 22:13:11 +02:00
  • 0df6c41eaa Compress image layer Konstantin Knizhnik 2024-03-11 18:03:59 +02:00
  • 91bd729be2 junk up owned_buffers_io from previous commit to deal with EphemeralFile speciality of reading zeroes past end-of-file Christian Schwarz 2024-03-13 18:19:44 +00:00
  • 4b84f23cea larger buffers for the write path Christian Schwarz 2024-03-13 16:01:27 +00:00
  • 41033f8952 Add downgrade scripts for neon extension. (#7065) Anastasia Lubennikova 2024-03-08 20:42:35 +00:00
  • 69338e53e3 throttling: fixup interactions with Timeline::get_vectored (#7089) Christian Schwarz 2024-03-13 18:49:17 +01:00
  • 5309711691 Make tenant_id in TenantLocationConfigRequest optional (#7055) Arpad Müller 2024-03-13 17:30:29 +01:00
  • 644c5e243d Revert "experiment(repeat, without preceding reverts) demonstrate that std-fs performs better because it hits the page cache" Christian Schwarz 2024-03-13 15:28:24 +00:00
  • d66ccbae5e experiment(repeat, without preceding reverts) demonstrate that std-fs performs better because it hits the page cache Christian Schwarz 2024-03-13 15:03:24 +00:00
  • 8a53d576e6 fix(metrics): time individual layer flush operations (#7109) Joonas Koivunen 2024-03-13 17:10:20 +02:00
  • 578a2d5d5f Revert "experiment: for create_delta_layer, use global io_engine, but inside a spawn_blocking single-threaded runtime" Christian Schwarz 2024-03-13 15:09:11 +00:00
  • c9d1f51a93 Revert "experiment: for create_delta_layer _write path_, use StdFs io engine in a spawn_blocking thread single-threaded runtime" Christian Schwarz 2024-03-13 15:09:06 +00:00
  • 1339834297 Revert "experiment: for EphemeralFile write path, use StdFs io engine" Christian Schwarz 2024-03-13 15:09:00 +00:00
  • 746fc530c5 "experiment: demonstrate that std-fs performs better because it hits the page cache" Christian Schwarz 2024-03-13 15:08:43 +00:00
  • 94311052cd previous commit's numbers were with all the preceding experiments Christian Schwarz 2024-03-13 15:08:11 +00:00
  • 2edbc07733 experiment: demonstrate that std-fs performs better because it hits the page cache Christian Schwarz 2024-03-13 15:03:24 +00:00
  • c8c04c0db8 experiment: for EphemeralFile write path, use StdFs io engine Christian Schwarz 2024-03-13 14:06:33 +00:00
  • 4a8e7f8716 experiment: for create_delta_layer _write path_, use StdFs io engine in a spawn_blocking thread single-threaded runtime Christian Schwarz 2024-03-13 13:41:38 +00:00
  • 72a8e090dd experiment: for create_delta_layer, use global io_engine, but inside a spawn_blocking single-threaded runtime Christian Schwarz 2024-03-13 12:49:45 +00:00
  • 0cf5619e4a Merge remote-tracking branch 'origin/main' into problame/integrate-tokio-epoll-uring/benchmarking/2024-01-31-prs/async-walredo Christian Schwarz 2024-03-13 13:58:00 +00:00
  • b0aff04157 proxy: add new dimension to exclude cplane latency (#7011) Anna Khanova 2024-03-13 16:50:05 +04:00
  • e0ea465aed Revert "experiment: Revert "tokio-epoll-uring: use it on the layer-creating code paths (#6378)"" Christian Schwarz 2024-03-13 12:45:53 +00:00
  • d3c157eeee experiment: Revert "tokio-epoll-uring: use it on the layer-creating code paths (#6378)" Christian Schwarz 2024-03-13 12:37:56 +00:00
  • c600355802 Revert "experiment: StdFs for EphemeralFile writes isn't the bottleneck" Christian Schwarz 2024-03-13 12:36:21 +00:00
  • 0554bee022 proxy: Report warm cold start if connection is from the local cache (#7104) Anna Khanova 2024-03-13 15:45:19 +04:00
  • 57241c1c5a experiment: StdFs for EphemeralFile writes isn't the bottleneck Christian Schwarz 2024-03-13 11:41:17 +00:00
  • 5598f712fa Fix LR tests waiting for synced data. lr-tests-catchup Arseny Sher 2024-03-13 13:42:49 +03:00
  • 83855a907c proxy http error classification (#7098) Conrad Ludgate 2024-03-13 06:35:49 +00:00
  • 1b41db8bdd pageserver: enable setting stripe size inline with split request. (#7093) John Spray 2024-03-12 20:41:08 +00:00
  • b9c30dbd6b fix the parametrization Christian Schwarz 2024-03-12 20:24:33 +00:00
  • 35f8735a27 wip Christian Schwarz 2024-03-12 20:13:44 +00:00
  • 095130c1b3 DO NOT MERGE: always parametrize Christian Schwarz 2024-03-12 19:55:46 +00:00
  • 5a0277476d Revert "make changes preparing next commit" Christian Schwarz 2024-03-12 20:09:07 +00:00
  • 6348833bdc expose that virtual_file_io_engine and get_vectored_impl were never set Christian Schwarz 2024-03-12 20:07:51 +00:00
  • dbabd4e4ea Revert "expose that pageserver_virtual_file_io_engine test param was never used (same for get_vectored_impl)" Christian Schwarz 2024-03-12 20:09:01 +00:00
  • 5b8888ce6b expose that pageserver_virtual_file_io_engine test param was never used (same for get_vectored_impl) Christian Schwarz 2024-03-12 19:54:59 +00:00
  • e85a631ddb make changes preparing next commit Christian Schwarz 2024-03-12 19:54:59 +00:00
  • 95deea4f39 Revert "Revert "tokio-epoll-uring: use it on the layer-creating code paths (#6378)"" Christian Schwarz 2024-03-12 18:53:16 +00:00
  • 9876045444 Revert "tokio-epoll-uring: use it on the layer-creating code paths (#6378)" Christian Schwarz 2024-03-12 18:53:11 +00:00
  • bac06ea1ac pageserver: fix read path max lsn bug (#7007) Jure Bajic 2024-03-12 17:32:47 +01:00
  • 7ae8364b0b storage controller: register nodes in re-attach request (#7040) John Spray 2024-03-12 14:47:12 +00:00
  • 1f7d54f987 proxy refactor tls listener (#7056) Conrad Ludgate 2024-03-12 13:05:40 +00:00
  • 580e136b2e Forward all backpressure feedback to compute (#7079) Arthur Petukhovsky 2024-03-12 13:14:02 +01:00
  • 09699d4bd8 proxy: cancel http queries on timeout (#7031) Conrad Ludgate 2024-03-12 11:52:00 +00:00
  • 89cf714890 tests/neon_local: rename "attachment service" -> "storage controller" (#7087) John Spray 2024-03-12 11:36:27 +00:00
  • 4363132305 libs/http: include path when logging auth failures jcsp/paths-on-auth-errors John Spray 2024-03-12 10:55:12 +00:00
  • 621ea2ec44 tests: try to make restored-datadir comparison tests not flaky v2 Heikki Linnakangas 2024-02-07 19:58:08 +02:00
  • 74d09b78c7 Keep walproposer alive until shutdown checkpoint is safe on safekepeers Heikki Linnakangas 2024-02-09 22:01:20 +02:00
  • 0cf0731d8b SIGQUIT instead of SIGKILL prewarmed postgres. Arseny Sher 2024-03-11 12:19:15 +03:00
  • 98723844ee Don't return from inside PG_TRY (#7095) Sasha Krassovsky 2024-03-11 10:36:39 -08:00
  • 73a8c97ac8 fix: warnings when compiling neon extensions (#7053) Alex Chi Z 2024-03-11 13:49:58 -04:00
  • 17a3c9036e follow-up(#7077): adjust flaky-test-detection cutoff date for tokio-epoll-uring (#7090) Christian Schwarz 2024-03-11 17:36:49 +01:00
  • 8c5b310090 fix: Layer delete on drop and eviction can outlive timeline shutdown (#7082) Joonas Koivunen 2024-03-11 17:54:06 +02:00
  • 42d0b040f8 Fix merge conflicts wal_lz4_compression Konstantin Knizhnik 2024-03-11 17:34:05 +02:00
  • 8224580f3e fix(tenant/timeline metrics): race condition during shutdown + recreation (#7064) Christian Schwarz 2024-03-11 15:41:41 +01:00
  • 2b0f3549f7 default to tokio-epoll-uring in CI tests & on Linux (#7077) Christian Schwarz 2024-03-11 15:35:59 +01:00
  • b4972d07d4 storage controller: refactor non-mutable members up into Service (#7086) John Spray 2024-03-11 14:29:32 +00:00
  • 26ae7b0b3e fix(metrics): reset TENANT_STATE metric on startup (#7084) Joonas Koivunen 2024-03-11 15:25:53 +02:00
  • c6ed86d3d0 Merge pull request #7081 from neondatabase/rc/2024-03-11 release-5090 Joonas Koivunen 2024-03-11 14:41:39 +02:00
  • f0a9017008 Export db size, deadlocks and changed row metrics (#7050) Roman Zaynetdinov 2024-03-11 10:10:04 +02:00
  • f8483cc4a3 pageserver: update swagger for HA APIs (#7070) John Spray 2024-03-11 09:32:17 +00:00
  • cc5d6c66b3 proxy: categorise new cplane error message (#7057) Conrad Ludgate 2024-03-11 08:20:09 +00:00
  • d894d2b450 Export db size, deadlocks and changed row metrics (#7050) Roman Zaynetdinov 2024-03-11 10:10:04 +02:00
  • 9832638c09 Add compression tag to BLOBs stored in image layer Konstantin Knizhnik 2023-12-08 23:26:01 +02:00
  • 62e7638c69 Store compression algorithm in image layer metadata Konstantin Knizhnik 2023-12-08 16:24:51 +02:00
  • 0dad8e427d Update pageserver/src/walingest.rs Konstantin Knizhnik 2023-12-07 21:27:42 +02:00
  • 4cfa2fdca5 Support compression of get_page responses Konstantin Knizhnik 2023-12-07 18:19:48 +02:00
  • 56ddf8e37f Build Postgres with lz4 support Konstantin Knizhnik 2023-12-07 09:09:11 +02:00
  • ed4bb3073f Resolve merge conflict Konstantin Knizhnik 2023-12-07 08:20:22 +02:00
  • b7e7aeed4d Peform compression of page images in storage Konstantin Knizhnik 2023-12-06 21:57:29 +02:00
  • a880178cca Support lx4 WAL compression Konstantin Knizhnik 2023-11-24 10:46:06 +02:00
  • 3c0eb1bf71 add timeout for read_version proxy-fix-http-auto-shutdown Conrad Ludgate 2024-03-10 09:32:26 +00:00
  • ec7c878364 remove unsafe Conrad Ludgate 2024-03-10 09:03:00 +00:00
  • 5d799f0a25 remove io fluff Conrad Ludgate 2024-03-10 08:53:37 +00:00