Commit Graph

  • c78c810118 pageserver: move out common compaction step John Spray 2024-06-29 21:51:10 +01:00
  • b9f1fa5edb pageserver: add LayerVisibility John Spray 2024-06-29 21:50:59 +01:00
  • 27fe7f8963 build(deps): bump certifi from 2023.7.22 to 2024.7.4 (#8301) vlad/asfsg dependabot[bot] 2024-07-06 17:41:54 +01:00
  • b874f1dc94 pageserver: maintain GcInfo incrementally (2/2) John Spray 2024-07-06 16:04:21 +01:00
  • 8b6e076983 pageserver: hold child timeline IDs in retain_lsns John Spray 2024-07-06 15:46:20 +01:00
  • 9d042caa0d pageserver: maintain GcInfo incrementally John Spray 2024-07-06 15:12:57 +01:00
  • a33b3d93f4 pageserver: ordered entries in sparse keyspace John Spray 2024-06-29 21:35:32 +01:00
  • 0a937b7f91 Add concurrency to the find-large-objects scrubber subcommand (#8291) Arpad Müller 2024-07-05 22:36:28 +02:00
  • b8d031cd0c Improve parsing of ImageCompressionAlgorithm (#8281) Arpad Müller 2024-07-05 22:18:05 +02:00
  • f0d29a0f3e pageserver_live_connections: track as counter pair (#8227) Christian Schwarz 2024-07-05 22:17:05 +02:00
  • 15aea8c8c2 postgres_backend: stop using async_trait Christian Schwarz 2024-07-05 21:37:31 +02:00
  • 13522fb722 Increase timeout for wating subscriber caught-up (#8118) Konstantin Knizhnik 2024-07-05 20:39:10 +03:00
  • 62b1e07b0f Consume fewer XIDs when restarting primary bump-nextXid-less-aggressively Heikki Linnakangas 2024-07-05 19:33:42 +03:00
  • b2c240e445 page_service: pagestream sub-protocol: only hold GateGuard while handling requests problame/slow-detach-encapsulated-handler-timeline Christian Schwarz 2024-07-05 13:29:44 +00:00
  • bc534e8bbb add sketch problame/slow-detach-fix-sketch Christian Schwarz 2024-07-05 14:40:57 +00:00
  • ed8aea612f Do not perform XID alignment because looks like it has no noticeable impact on performance but can cause problrems with restoring running xacts from CLOG no_xid_alignment Konstantin Knizhnik 2024-07-05 18:01:33 +03:00
  • c9fd8d7693 SELECT 💣(); (#8270) Alexander Bayandin 2024-07-05 15:12:01 +01:00
  • 7dd2e447d3 pageserver: add time based image layer creation check (#8247) Vlad Lazar 2024-07-05 14:02:02 +01:00
  • 9e7271de01 HACK: tolerate the mismatches from isolation tests jcsp/pg-isolation-mismatches John Spray 2024-07-05 11:56:29 +00:00
  • 9fb17dba04 Add neon.max_vacuum_defer_cleanup_age to restrict bloat of master in case of using hot_standby_feedback max_vacuum_defer_cleanup_age Konstantin Knizhnik 2024-07-05 14:21:25 +03:00
  • eafa5d2db8 tests: full compaction at end of pg_regress tests jcsp/pg-regress-with-compaction John Spray 2024-07-05 11:06:17 +00:00
  • efccf6cb79 tests: common post-test checks in pg_regress John Spray 2024-07-05 10:55:36 +00:00
  • 9fc9553e1f pageserver: fix dropping backtrace from CreateImageLayersError John Spray 2024-07-05 10:34:48 +00:00
  • bc87e78f1e pageserver: respect has_relmap_file in collect_keyspace John Spray 2024-07-05 10:06:55 +00:00
  • 2bdb79e17a tests: use smaller layers in test_pg_regress John Spray 2024-07-02 14:06:47 +00:00
  • 6849ae4810 safekeeper: add separate tombstones map for deleted timelines (#8253) John Spray 2024-07-05 11:17:44 +01:00
  • 5aae80640b tests: make location_conf_churn more robust (#8271) John Spray 2024-07-05 10:34:16 +01:00
  • 6876f0d066 correct error handling for periodic pagebench runner status (#8274) Peter Bendel 2024-07-05 11:23:46 +02:00
  • e25ac31fc9 tests: extend allow list in deletion test (#8268) John Spray 2024-07-05 10:09:15 +01:00
  • 711716c725 add checkout depth1 to workflow to access local github actions like generate allure report (#8259) Peter Bendel 2024-07-04 22:17:45 +02:00
  • 88b13d4552 implement rolling hyper-log-log algorithm (#8068) Konstantin Knizhnik 2024-07-04 22:03:58 +03:00
  • feeb2dc6fa Merge pull request #8217 from neondatabase/rc/2024-07-01 release-5837 Arseny Sher 2024-07-04 20:22:51 +03:00
  • adde0ecfe0 Flatten compression algorithm setting (#8265) Arpad Müller 2024-07-04 18:59:19 +02:00
  • 57f476ff5a Restore running xacts from CLOG on replica startup (#7288) Heikki Linnakangas 2024-07-01 12:58:12 +03:00
  • 7ee2bebdb7 tests: Make neon_xlogflush() flush all WAL, if you omit the LSN arg Heikki Linnakangas 2024-07-01 12:58:08 +03:00
  • be598f1bf4 tests: remove a leftover 'running' flag (#8216) Heikki Linnakangas 2024-07-01 11:23:31 +03:00
  • 19accfee4e feat(pageserver): integrate lsn lease into synthetic size (#8220) Yuchen Liang 2024-07-04 11:09:05 -04:00
  • e579bc0819 Add find-large-objects subcommand to scrubber (#8257) Arpad Müller 2024-07-04 17:07:16 +02:00
  • c9e6dd45d3 pageserver: downgrade stale generation messages to INFO (#8256) John Spray 2024-07-04 15:05:41 +01:00
  • bf9fc77061 CI(pg-clients): unify workflow with build-and-test (#8160) Alexander Bayandin 2024-07-04 14:58:01 +01:00
  • a004d27fca Use bool param for round_trip_test_compressed (#8252) Arpad Müller 2024-07-04 15:04:08 +02:00
  • a46253766b pageserver: increase rate limit duration for layer visit log (#8263) Vlad Lazar 2024-07-04 13:22:33 +01:00
  • 5b69b32dc5 CI(build-and-test): add conclusion job (#8246) Alexander Bayandin 2024-07-04 09:20:01 +01:00
  • e03c3c9893 proxy: cache certain non-retriable console errors for a short time (#8201) Conrad Ludgate 2024-07-04 09:03:03 +01:00
  • bbb2fa7cdd tests: perform graceful rolling restarts in storcon scale test (#8173) rc/proxy/2024-07-04 Vlad Lazar 2024-07-04 06:04:19 +01:00
  • 778787d8e9 pageserver: add supplementary branch usage stats (#8131) John Spray 2024-07-03 22:29:43 +01:00
  • 90b51dcf16 fix(pageserver): ensure test creates valid layer map (#8191) Alex Chi Z 2024-07-03 14:46:58 -04:00
  • a85aa03d18 page_service: stop exposing get_last_record_rlsn (#8244) Christian Schwarz 2024-07-03 20:05:01 +02:00
  • cdaed4d79c Fix outdated comment (#8149) Japin Li 2024-07-04 01:55:36 +08:00
  • ea0b22a9b0 pageserver: reduce ops tracked at per-timeline detail (#8245) John Spray 2024-07-03 17:27:34 +01:00
  • 392a58bdce add pagebench test cases for periodic pagebench on dedicated hardware (#8233) Peter Bendel 2024-07-03 18:22:33 +02:00
  • e0891ec8c8 Only support compressed reads if the compression setting is present (#8238) Arpad Müller 2024-07-03 18:02:10 +02:00
  • 97f7188a07 pageserver: don't try to flush if shutdown during attach (#8235) John Spray 2024-07-03 14:13:06 +01:00
  • 56580cf72a Add compaction logging for debugging vlad/compaction-logging Vlad Lazar 2024-07-03 13:50:43 +01:00
  • aae3876318 CI: update docker/* actions to latest versions (#7694) Alexander Bayandin 2024-07-03 12:19:13 +01:00
  • dae55badf3 Simplify test_wal_page_boundary_start test (#8214) Heikki Linnakangas 2024-07-03 13:22:53 +03:00
  • 4273309962 docker: add storage_scrubber into the docker image (#8239) Alex Chi Z 2024-07-03 04:48:56 -04:00
  • 4a0c2aebe0 Add test for proper handling of connection failure to avoid 'cannot wait on socket event without a socket' error (#8231) Konstantin Knizhnik 2024-07-02 21:45:42 +03:00
  • 6f07fc933f notes problame/slow-detach-debug Christian Schwarz 2024-07-02 17:32:38 +00:00
  • 45035ca950 Revert "toy around with different ways to shut down" Christian Schwarz 2024-07-02 17:33:22 +00:00
  • d359d88f51 toy around with different ways to shut down Christian Schwarz 2024-07-02 17:32:19 +00:00
  • 891cb5a9a8 fix(pageserver): comments about metadata key range (#8236) Alex Chi Z 2024-07-02 12:54:32 -04:00
  • f5832329ac tense of errors (#8234) John Spray 2024-07-02 17:17:22 +01:00
  • 6216df7765 CI(benchmarking): move psql queries to actions/run-python-test-set (#8230) Alexander Bayandin 2024-07-02 16:21:23 +01:00
  • 5de896e7d8 L0 flush: opt-in mechanism to bypass PageCache reads and writes (#8190) Christian Schwarz 2024-07-02 16:29:09 +02:00
  • 25eefdeb1f Add support for reading and writing compressed blobs (#8106) Arpad Müller 2024-07-02 16:14:12 +02:00
  • 28929d9cfa pageserver: rate limit log for loads of layers visited (#8228) Vlad Lazar 2024-07-02 14:14:10 +01:00
  • 9b4b4bbf6f fix: noisy logging when download gets cancelled during shutdown (#8224) Christian Schwarz 2024-07-02 15:13:27 +02:00
  • 80f68a0029 Use bounds() function arpad/slices_in_write_path Arpad Müller 2024-07-02 14:57:20 +02:00
  • 1a0f545c16 pageserver: simpler, stricter config error handling (#8177) John Spray 2024-07-02 13:45:04 +01:00
  • 7dcdbaa25e remote_storage config: move handling of empty inline table {} to callers (#8193) Christian Schwarz 2024-07-02 12:53:08 +02:00
  • 9a134a8f18 Fix tests Arpad Müller 2024-07-02 12:11:46 +02:00
  • 0497b99f3a Check status of connection after PQconnectStartParams (#8210) Konstantin Knizhnik 2024-07-02 06:56:10 +03:00
  • 9290f57750 Return the entire buffer in BlobWriter as well Arpad Müller 2024-07-02 01:28:27 +02:00
  • 6202c84408 Actually return the same slice Arpad Müller 2024-07-02 01:05:41 +02:00
  • 9882ac8e06 docs: Graceful storage controller cluster restarts RFC (#7704) Vlad Lazar 2024-07-01 18:44:28 +01:00
  • 85260b4905 Fix tests as well Arpad Müller 2024-07-01 19:30:07 +02:00
  • 03613b0017 slipped a comment in Christian Schwarz 2024-07-01 17:04:39 +00:00
  • bdedd2192b Use Slice<_> in write path instead of B: BoundedBuf<...> Arpad Müller 2024-07-01 18:51:29 +02:00
  • 4841f93c3e fix: noisy logging when download gets cancelled during shutdown Christian Schwarz 2024-07-01 16:44:17 +00:00
  • 0789160ffa tests: Make neon_xlogflush() flush all WAL, if you omit the LSN arg (#8215) Heikki Linnakangas 2024-07-01 18:55:18 +03:00
  • 9c32604aa9 CI(gather-rust-build-stats): fix build with libpq (#8219) Alexander Bayandin 2024-07-01 16:42:23 +01:00
  • b02aafdfda fix(pageserver): include aux file in basebackup only once (#8207) Alex Chi Z 2024-07-01 10:36:49 -04:00
  • 62bb054d87 Merge branch 'main' into bayandin/replace-cachepot-with-sccache bayandin/replace-cachepot-with-sccache Alexander Bayandin 2024-07-01 15:14:26 +01:00
  • e823b92947 CI(build-tools): Remove libpq from build image (#8206) Alexander Bayandin 2024-07-01 13:11:55 +01:00
  • aea5cfe21e pageserver: add metric pageserver_secondary_resident_physical_size (#8204) John Spray 2024-07-01 12:48:20 +01:00
  • 9ce193082a Restore running xacts from CLOG on replica startup (#7288) Heikki Linnakangas 2024-07-01 12:58:12 +03:00
  • 75c84c846a tests: Make neon_xlogflush() flush all WAL, if you omit the LSN arg Heikki Linnakangas 2024-07-01 12:58:08 +03:00
  • f12bb1b957 Fix test, now really fix/ps-connect/check-for-response-status Matthias van de Meent 2024-07-01 10:56:48 +02:00
  • 57535c039c tests: remove a leftover 'running' flag (#8216) Heikki Linnakangas 2024-07-01 11:23:31 +03:00
  • 30027d94a2 Fix tracking of the nextMulti in the pageserver's copy of CheckPoint (#6528) rc/2024-07-01-without-clog-recovery Heikki Linnakangas 2024-07-01 01:49:49 +03:00
  • 13a0abcf71 XXX: Add test that currently fails. add-logical-rep-restart-test Heikki Linnakangas 2024-07-01 00:07:12 +03:00
  • 6fca885a86 CI(compute-tools): enable sccache Alexander Bayandin 2024-06-30 11:15:40 +01:00
  • 0a0e7f3486 CI(check-codestyle-rust): use sccache Alexander Bayandin 2024-06-30 10:31:23 +01:00
  • c90f212450 sccache -s -> sccache --show-stats Alexander Bayandin 2024-06-30 09:37:11 +01:00
  • 31fa86302f CI(neon-build): enable sccache Alexander Bayandin 2024-06-30 00:57:01 +01:00
  • 61fac26c76 CI(neon-build): print sccache stats Alexander Bayandin 2024-06-30 00:39:39 +01:00
  • 6921cc84d8 Do not set sccache by default Alexander Bayandin 2024-06-30 00:36:23 +01:00
  • 08da1327c1 Pass AWS creds to docker build Alexander Bayandin 2024-06-29 23:43:01 +01:00
  • b7e72e56f8 Set SCCACHE_IGNORE_SERVER_IO_ERROR=1 Alexander Bayandin 2024-06-29 11:38:50 +01:00