Commit Graph

  • a8be0f3376 add a doc comment John Spray 2024-08-05 12:18:06 +00:00
  • bb86bd230d Edit revisions.json log_opaque_newpages Konstantin Knizhnik 2024-08-05 14:57:26 +03:00
  • 0f855757a8 Bump postgres version Konstantin Knizhnik 2024-08-02 13:50:04 +03:00
  • 33f2a2bc55 Use prefetch for reading DuckDB pages Konstantin Knizhnik 2024-08-02 07:38:23 +03:00
  • 06b8f013f0 Supprot opaque mode for log_newpages Konstantin Knizhnik 2024-08-01 23:12:23 +03:00
  • bd845c7587 CI(trigger-e2e-tests): wait for promote-images job from the last commit (#8592) Alexander Bayandin 2024-08-05 12:25:23 +01:00
  • f63c8e5a8c Update Postgres versions to use smgrexists() instead of access() to check if Oid is used (#8597) Konstantin Knizhnik 2024-08-05 14:24:54 +03:00
  • 200fa56b04 feat(pageserver): support split delta layers (#8599) Alex Chi Z. 2024-08-05 18:30:49 +08:00
  • 0f3dac265b safekeeper: remove unused partial_backup_enabled option (#8547) dotdister 2024-08-05 16:23:59 +09:00
  • fde8aa103e feat(pageserver): support auto split layers based on size (#8574) Alex Chi Z. 2024-08-05 13:55:36 +08:00
  • 8624aabc98 fix(pageserver): deadlock in gc-compaction (#8590) Alex Chi Z. 2024-08-02 19:52:04 -04:00
  • 3a10bf8c82 tests: add test_historic_storage_formats (#8423) John Spray 2024-08-02 18:28:23 +01:00
  • 1758c10dec Improve safekeepers eviction rate limiting (#8456) Arthur Petukhovsky 2024-08-02 15:26:46 +01:00
  • 7eb3d6bb2d Wait for completion of the upload queue in flush_frozen_layer (#8550) Arpad Müller 2024-08-02 13:07:12 +02:00
  • 3833e30d44 storage_controller: start adding chaos hooks (#7946) John Spray 2024-08-02 09:37:44 +01:00
  • 4631179320 pageserver: refine how we delete timelines after shard split (#8436) John Spray 2024-08-02 08:00:46 +01:00
  • 4eea3ce705 test_runner: don't create artifacts if Allure is not enabled (#8580) Alexander Bayandin 2024-08-01 16:55:43 +01:00
  • a9bcabe503 fix(pageserver): skip existing layers for btm-gc-compaction (#8498) Alex Chi Z. 2024-08-01 10:00:06 -04:00
  • 7a2625b803 storage-scrubber: log version on start (#8571) Alex Chi Z. 2024-08-01 09:52:34 -04:00
  • f51dc6a44e pageserver: add layer visibility calculation (#8511) John Spray 2024-08-01 10:25:35 +01:00
  • a22361b57b Reduce linux-raw-sys duplication (#8577) Arpad Müller 2024-08-01 10:22:21 +02:00
  • 1e6a1ac9fa pageserver: shutdown all walredo managers 8s into shutdown (#8572) Christian Schwarz 2024-08-01 07:57:09 +02:00
  • 02e8fd0b52 test(pageserver): add test_gc_feedback_with_snapshots (#8474) Alex Chi Z. 2024-07-31 17:55:19 -04:00
  • 8adc4031d0 CI(create-test-report): fix missing benchmark results in Allure report (#8540) Alexander Bayandin 2024-07-31 19:47:59 +01:00
  • 46379cd3f2 storage_scrubber: migrate FindGarbage to remote_storage (#8548) Arpad Müller 2024-07-31 20:24:42 +02:00
  • b3a76d9601 controller: simplify reconciler generation increment logic (#8560) John Spray 2024-07-31 18:37:47 +01:00
  • 6c1bbe8434 cicd: change Azure storage details [2/2] (#8562) Cihan Demirci 2024-07-31 19:42:10 +03:00
  • a006f7656e Fix negative replication delay metric Tristan Partin 2024-07-25 15:45:15 -05:00
  • 31122adee3 refactor(page_service): Timeline gate guard holding + cancellation + shutdown (#8339) Christian Schwarz 2024-07-31 17:05:45 +02:00
  • 311cc71b08 feat(pageserver): support btm-gc-compaction for child branches (#8519) Alex Chi Z. 2024-07-31 10:48:48 -04:00
  • 0356fc426b CI(regress-tests): run less regression tests (#8561) Alexander Bayandin 2024-07-31 15:10:27 +01:00
  • 35738ca37f compaction_level0_phase1: bypass PS PageCache for data blocks (#8543) Christian Schwarz 2024-07-31 14:17:59 +02:00
  • fa24d27d38 cicd: change Azure storage details [1/2] (#8553) Cihan Demirci 2024-07-30 22:34:15 +03:00
  • fb6c1e9390 cleanup(compact_level0_phase1): some commentary and wrapping into block expressions (#8544) Christian Schwarz 2024-07-30 18:13:18 +02:00
  • d1d4631c8f feat(scrubber): post scan_metadata results to storage controller (#8502) Yuchen Liang 2024-07-30 11:07:34 -04:00
  • b87a1384f0 feat(storcon): store scrubber metadata scan result (#8480) Yuchen Liang 2024-07-30 09:32:00 -04:00
  • 5702e1cb46 [neon/acr] impr: push to ACR while building images (#8545) Anton Chaporgin 2024-07-30 16:15:53 +03:00
  • 5be3e09082 CI(benchmarking): make neonvm default provisioner (#8538) Alexander Bayandin 2024-07-30 13:38:23 +01:00
  • cd3f4b3a53 scrubber: add remote_storage based listing APIs and use them in find-large-objects (#8541) Arpad Müller 2024-07-30 11:00:37 +02:00
  • 57f22178d7 Add metrics for input data considered and taken for compression (#8522) Arpad Müller 2024-07-30 09:59:15 +02:00
  • 3f05758d09 scrubber: enable cleaning up garbage tenants from known deletion bugs, add object age safety check (#8461) John Spray 2024-07-29 17:50:44 +01:00
  • 010203a49e l0_flush: use mode=direct by default => coverage in automated tests (#8534) Christian Schwarz 2024-07-29 16:49:22 +02:00
  • 7c40266c82 pageserver: fix return code from secondary_download_handler (#8508) John Spray 2024-07-29 15:05:30 +01:00
  • 7b3f94c1f0 test: deflake test_duplicate_creation (#8536) Joonas Koivunen 2024-07-29 15:41:06 +03:00
  • d8205248e2 Add a test for clickhouse as a logical replication consumer (#8408) a-masterov 2024-07-29 14:35:12 +02:00
  • a4d3e0c747 Adopt list_streaming in tenant deletion (#8504) Arpad Müller 2024-07-29 12:05:18 +02:00
  • 1dc496a2c9 feat(pageserver): support auto split layers based on size (#8574) Alex Chi Z. 2024-08-05 13:55:36 +08:00
  • 6814bdd30b fix(pageserver): deadlock in gc-compaction (#8590) Alex Chi Z. 2024-08-02 19:52:04 -04:00
  • 0a667bc8ef tests: add test_historic_storage_formats (#8423) John Spray 2024-08-02 18:28:23 +01:00
  • f3acfb2d80 Improve safekeepers eviction rate limiting (#8456) Arthur Petukhovsky 2024-08-02 15:26:46 +01:00
  • 417b1319cd DNM debug jcsp/ingest-refactor John Spray 2024-08-02 13:29:24 +01:00
  • 8c828c586e Wait for completion of the upload queue in flush_frozen_layer (#8550) Arpad Müller 2024-08-02 13:07:12 +02:00
  • c2aadb0c7f wip2 John Spray 2024-08-02 10:53:36 +01:00
  • 00648a9c49 pageserver: start refactoring ingest metadata ops John Spray 2024-08-02 10:02:26 +01:00
  • 2334fed762 storage_controller: start adding chaos hooks (#7946) John Spray 2024-08-02 09:37:44 +01:00
  • f39fefd8ae dnm: test ci fcdm/simple2 Cihan Demirci 2024-08-02 10:13:36 +03:00
  • c53799044d pageserver: refine how we delete timelines after shard split (#8436) John Spray 2024-08-02 08:00:46 +01:00
  • e7477855b7 test_runner: don't create artifacts if Allure is not enabled (#8580) Alexander Bayandin 2024-08-01 16:55:43 +01:00
  • 5dcfe1c4b8 pageserver: downgrade an assertion to debug John Spray 2024-04-17 15:58:11 +01:00
  • ae7d635098 pageserver: add ingest bench John Spray 2024-08-01 14:27:02 +00:00
  • 137cbb4db4 pageserver: refactor DeltaLayerWriter to not need a Timeline John Spray 2024-04-17 12:48:03 +01:00
  • 74eda0b0b7 pageserver: make bench'able methods public John Spray 2024-04-17 13:28:07 +01:00
  • f4a668a27d fix(pageserver): skip existing layers for btm-gc-compaction (#8498) Alex Chi Z. 2024-08-01 10:00:06 -04:00
  • 970f2923b2 storage-scrubber: log version on start (#8571) Alex Chi Z. 2024-08-01 09:52:34 -04:00
  • 1678dea20f pageserver: add layer visibility calculation (#8511) John Spray 2024-08-01 10:25:35 +01:00
  • 163f2eaf79 Reduce linux-raw-sys duplication (#8577) Arpad Müller 2024-08-01 10:22:21 +02:00
  • 980d506bda pageserver: shutdown all walredo managers 8s into shutdown (#8572) rc/proxy/2024-08-01 Christian Schwarz 2024-08-01 07:57:09 +02:00
  • d6c79b77df test(pageserver): add test_gc_feedback_with_snapshots (#8474) Alex Chi Z. 2024-07-31 17:55:19 -04:00
  • 3350daeb9a CI(create-test-report): fix missing benchmark results in Allure report (#8540) Alexander Bayandin 2024-07-31 19:47:59 +01:00
  • 939d50a41c storage_scrubber: migrate FindGarbage to remote_storage (#8548) Arpad Müller 2024-07-31 20:24:42 +02:00
  • 2f9ada13c4 controller: simplify reconciler generation increment logic (#8560) John Spray 2024-07-31 18:37:47 +01:00
  • ff51b565d3 cicd: change Azure storage details [2/2] (#8562) Cihan Demirci 2024-07-31 19:42:10 +03:00
  • 5e0409de95 Fix negative replication delay metric Tristan Partin 2024-07-25 15:45:15 -05:00
  • 4e3b70e308 refactor(page_service): Timeline gate guard holding + cancellation + shutdown (#8339) Christian Schwarz 2024-07-31 17:05:45 +02:00
  • 61a65f61f3 feat(pageserver): support btm-gc-compaction for child branches (#8519) Alex Chi Z. 2024-07-31 10:48:48 -04:00
  • f8ce169e2a dnm: test fcdm/testch Cihan Demirci 2024-07-31 15:16:09 +03:00
  • d21246c8bd CI(regress-tests): run less regression tests (#8561) Alexander Bayandin 2024-07-31 15:10:27 +01:00
  • 4825b0fec3 compaction_level0_phase1: bypass PS PageCache for data blocks (#8543) Christian Schwarz 2024-07-31 14:17:59 +02:00
  • a4df3c8488 cicd: change Azure storage details [1/2] (#8553) Cihan Demirci 2024-07-30 22:34:15 +03:00
  • 71ff8f2433 storcon: implement graceful leader cutover vlad/storcon-leader-db-table Vlad Lazar 2024-07-30 17:39:10 +01:00
  • 56c43c4fae storcon: add start-up sequence utilities Vlad Lazar 2024-07-30 17:37:04 +01:00
  • 4187657082 storcon: refactor building of observed state at start-up Vlad Lazar 2024-07-29 17:49:32 +01:00
  • b690ba5838 storcon: decouple initial heartbeat round from location listing Vlad Lazar 2024-07-29 14:21:53 +01:00
  • dd7cafdd97 storcon: add storage controller peer client Vlad Lazar 2024-07-29 13:10:37 +01:00
  • c501a10612 storcon: gate starting-up as candidate behind a flag Vlad Lazar 2024-07-26 16:54:12 +01:00
  • 1fdbef9a44 storcon/persistence: add leader table primitives Vlad Lazar 2024-07-26 16:50:12 +01:00
  • 3ad1221e55 storcon/diesel: add leader table Vlad Lazar 2024-07-26 16:49:51 +01:00
  • d95b46f3f3 cleanup(compact_level0_phase1): some commentary and wrapping into block expressions (#8544) Christian Schwarz 2024-07-30 18:13:18 +02:00
  • 85bef9f05d feat(scrubber): post scan_metadata results to storage controller (#8502) Yuchen Liang 2024-07-30 11:07:34 -04:00
  • fc0d304fc9 dnm: test minor change fcdm/minor Cihan Demirci 2024-07-30 18:06:14 +03:00
  • e374d6778e feat(storcon): store scrubber metadata scan result (#8480) fcdm/test-oidc2 Yuchen Liang 2024-07-30 09:32:00 -04:00
  • 9ceaf9a986 [neon/acr] impr: push to ACR while building images (#8545) Anton Chaporgin 2024-07-30 16:15:53 +03:00
  • f72fe68626 CI(benchmarking): make neonvm default provisioner (#8538) Alexander Bayandin 2024-07-30 13:38:23 +01:00
  • 9fabdda2dc scrubber: add remote_storage based listing APIs and use them in find-large-objects (#8541) Arpad Müller 2024-07-30 11:00:37 +02:00
  • 1c7b06c988 Add metrics for input data considered and taken for compression (#8522) Arpad Müller 2024-07-30 09:59:15 +02:00
  • 52b02d95c8 scrubber: enable cleaning up garbage tenants from known deletion bugs, add object age safety check (#8461) John Spray 2024-07-29 17:50:44 +01:00
  • df0748289b Merge pull request #8533 from neondatabase/rc/2024-07-29 release-6210 Joonas Koivunen 2024-07-29 19:14:29 +03:00
  • 407bf968c1 Merge remote-tracking branch 'origin/release' into rc/2024-07-29 Joonas Koivunen 2024-07-29 15:15:04 +00:00
  • e0a5bb17ed pageserver: fail if id is present in pageserver.toml (#8489) Christian Schwarz 2024-07-29 16:16:32 +02:00
  • 4be58522fb l0_flush: use mode=direct by default => coverage in automated tests (#8534) Christian Schwarz 2024-07-29 16:49:22 +02:00