Commit Graph

  • a08f49f43e DNM: add taskdump probame/tokio-task-dump Christian Schwarz 2025-01-21 00:10:20 +01:00
  • 081ff26519 fixup 40ab9c2c5e: deadlock Christian Schwarz 2025-01-20 20:47:21 +01:00
  • 0a37164c29 replace env var with config variable; add test suite fixture env var to override default Christian Schwarz 2025-01-20 23:35:47 +01:00
  • 2ab9f69825 Simplify pageserver_physical_gc function (#10104) Arpad Müller 2025-01-20 22:57:15 +01:00
  • 2de2b26c62 feat(pageserver): add reldir migration configs (#10439) Alex Chi Z. 2025-01-20 15:44:12 -05:00
  • 0eff09e35f Merge remote-tracking branch 'origin/main' into vlad/read-path-concurrent-io Christian Schwarz 2025-01-20 19:46:44 +01:00
  • e781cf6dd8 Compute/LFC: Apply limits consistently (#10449) Matthias van de Meent 2025-01-20 19:29:21 +01:00
  • cdad6b2de5 we don't need the CancellationToken, the ios_rx.recv() will fail at the same time Christian Schwarz 2025-01-20 19:13:40 +01:00
  • 82d20b52b3 make noise when dropping an IoConcurrency with unfinished requests Christian Schwarz 2025-01-20 19:12:00 +01:00
  • 72130d7d6c fix(page_service / handle): panic when parallel client disconnect & Timeline shutdown (#10445) Christian Schwarz 2025-01-20 18:51:30 +01:00
  • 2657b7ec75 rfcs: add sharded ingest RFC (#8754) John Spray 2025-01-20 17:33:07 +00:00
  • 68e7e0f0f6 pageserver: log on potentially stuck connection manager loop Vlad Lazar 2025-01-20 18:26:33 +01:00
  • 0acc612e3e impr(proxy): introduce proxy_id for cancel key proxy_id Ivan Efremov 2025-01-20 18:43:16 +02:00
  • d40272f783 Prevent LFC overflow by skipping write when not unpinned pages are available lfc_strict_limit Konstantin Knizhnik 2025-01-20 18:19:06 +02:00
  • 3b1328423e basebackup: fetch all SLRUs of one basebackup using the same IoConcurrency Christian Schwarz 2025-01-20 16:58:14 +01:00
  • 4dec0dddc6 Merge pull request #10447 from neondatabase/releases/2025-01-20-hotfix release-7576 Christian Schwarz 2025-01-20 15:55:44 +01:00
  • 02fc58b878 impr(timeline handles): add more tests covering reference cyle (#10446) Christian Schwarz 2025-01-20 15:37:24 +01:00
  • e0c504af38 fix(page_service / handle): panic when parallel client disconnect & Timeline shutdown Christian Schwarz 2025-01-20 13:42:44 +01:00
  • b312a3c320 Move DeleteTimelineFlow::prepare to separate function and use enum (#10334) Arpad Müller 2025-01-20 13:50:44 +01:00
  • 8cd8164926 fix clippy Gleb Novikov 2025-01-20 12:48:09 +00:00
  • 8be17724d8 Add two safekeeper proto versions to test_normal_work. Arseny Sher 2025-01-20 11:22:14 +01:00
  • 234c3a29df Pass proto selection to safekeeper, prepare parsing v3. Arseny Sher 2025-01-20 11:18:26 +01:00
  • 7d761a9d22 storage controller: make chaos less disruptive to AZ locality (#10438) John Spray 2025-01-20 09:47:23 +00:00
  • 8bdaee35f3 pageserver: safety checks on validity of uploaded indices (#10403) John Spray 2025-01-20 09:20:31 +00:00
  • bf2c3a1a27 WIP problame/broker-spof/tlaspec Christian Schwarz 2025-01-20 00:21:28 +01:00
  • 071c5710c5 offline-ness Christian Schwarz 2025-01-19 22:16:58 +01:00
  • aadbdf19d6 previous commit caused compile errors BodoBolero 2025-01-19 18:39:15 +01:00
  • 7ab475520d remove unneeded tpch extension BodoBolero 2025-01-19 18:13:15 +01:00
  • 0654c03d18 try to statically link some important duckdb extensions BodoBolero 2025-01-19 18:11:20 +01:00
  • 933b4719cb sketch a spec for replicated broker Christian Schwarz 2025-01-19 16:40:32 +01:00
  • 0c54e5fb83 code reading notes from last weekend problame/broker-spof/code-reading-notes Christian Schwarz 2025-01-19 16:21:48 +01:00
  • 99a4588c02 Moved postgres process from main into a separate class Gleb Novikov 2025-01-18 11:52:03 +00:00
  • b0f34099f9 Add safekeeper utilization endpoint (#10429) Arpad Müller 2025-01-17 22:43:52 +01:00
  • 0aa4fea432 Merge branch '22037-basic-fast-import-e2e' into cloud-22775-restore-to-connstring Gleb Novikov 2025-01-17 17:53:44 +00:00
  • 3399eea2ed Merge pull request #10436 from neondatabase/rc/release/2025-01-17 release-7574 Alex Chi Z. 2025-01-17 12:36:17 -05:00
  • 2eb235e923 doc string explaining why we're deadlock free right now and why it's so brittle Christian Schwarz 2025-01-17 18:33:34 +01:00
  • 40ab9c2c5e we can avoid adding the Arc<Mutex<>> around EphemeralLayer if we instead extend the lifetime of the InMemoryLayer for the spawned IO future; plus it's semantically more similar to what we now do for Delta and Image layers Christian Schwarz 2025-01-17 18:16:17 +01:00
  • c43400389f delta & image layer spawned IOs: keep layer resident until IO is done Christian Schwarz 2025-01-17 18:00:13 +01:00
  • 6a29c809d5 Merge branch 'release' of https://github.com/neondatabase/neon into rc/release/2025-01-17 Alex Chi Z 2025-01-17 10:44:25 -05:00
  • fd09d3164c shorter pg_port definition Gleb Novikov 2025-01-17 15:34:38 +00:00
  • 6975228a76 pageserver: add initdb metrics (#10434) Vlad Lazar 2025-01-17 14:51:33 +00:00
  • 053abff71f Fix dependency on neon-image in promote-images-dev (#10437) JC Grünhage 2025-01-17 15:21:30 +01:00
  • 7754a28cf5 run test_fast_import_binary on all pg versions Gleb Novikov 2025-01-17 11:28:39 +00:00
  • 6ace425d3d Merge branch '22037-basic-fast-import-e2e' into cloud-22775-restore-to-connstring Gleb Novikov 2025-01-17 11:27:30 +00:00
  • cf8654b3e5 Revert "Removed version limitation from fast import tests" Gleb Novikov 2025-01-17 11:27:10 +00:00
  • a6a42c58c3 fix typo BodoBolero 2025-01-17 12:00:43 +01:00
  • b6c010035f patch for duckdb that allows to install extension httpfs even if disabled_filesystems='LocalFileSystem' BodoBolero 2025-01-17 11:20:55 +01:00
  • fec5ac5838 storage controller: a more comprehensive log on tenant creation jcsp/friday-nits John Spray 2025-01-17 09:54:05 +00:00
  • a62c01df4c Storage release 2025-01-17 github-actions[bot] 2025-01-17 06:02:11 +00:00
  • 871e8b325f Use the request ID given by the control plane in compute_ctl (#10418) Tristan Partin 2025-01-16 14:46:53 -06:00
  • c47c5f4ace fix(page_service pipelining): tenant cannot shut down because gate kept open while flushing responses (#10386) Christian Schwarz 2025-01-16 21:34:02 +01:00
  • b0838a68e5 Enable pgx_ulid on Postgres 17 (#10397) Tristan Partin 2025-01-16 13:49:04 -06:00
  • d71bece102 Trace 'out of shared memory' errors out_of_shared_memory Konstantin Knizhnik 2025-01-16 21:19:38 +02:00
  • 21725fe377 Trace 'out of shared memory' errors Konstantin Knizhnik 2025-01-16 21:19:23 +02:00
  • 0e405444b2 (manual cherry-pick) fast import: optional restore_connstring, skip running postgres if specified Gleb Novikov 2025-01-16 19:08:42 +00:00
  • 65932512c1 run tests with futures-unordered Christian Schwarz 2025-01-16 20:03:01 +01:00
  • 1866f261e0 make mypy pass Christian Schwarz 2025-01-16 20:01:42 +01:00
  • 8f2ebc0684 tests: stabilize test_storage_controller_node_deletion (#10420) John Spray 2025-01-16 19:00:16 +00:00
  • 3a285a046b pageserver: include node id when subscribing to SK (#10432) Vlad Lazar 2025-01-16 18:51:56 +00:00
  • 7c662b771a Merge branch 'problame/hung-shutdown/fix' into vlad/read-path-concurrent-io Christian Schwarz 2025-01-16 19:22:38 +01:00
  • 8f40bd4eb3 there is no Error Fe message -,- Christian Schwarz 2025-01-16 19:19:13 +01:00
  • 0dda2ad7ec fast import: added a test that restores into a running postgres by connstring Gleb Novikov 2025-01-16 18:05:21 +00:00
  • 047b986f7f Removed version limitation from fast import tests Gleb Novikov 2025-01-16 17:45:22 +00:00
  • da13154791 storcon: revise fill logic to prioritize AZ (#10411) John Spray 2025-01-16 17:33:46 +00:00
  • d2f8342080 Merge branch 'problame/hung-shutdown/fix' into vlad/read-path-concurrent-io Christian Schwarz 2025-01-16 18:16:36 +01:00
  • 92e4dd7ffa script: template NEON_REPO_DIR Christian Schwarz 2025-01-16 18:14:34 +01:00
  • 0c3ab9c494 move test message tag to 99 and represent Fe message tag as enum, like we do for Be message Christian Schwarz 2025-01-16 18:07:56 +01:00
  • 2e13a3aa7a storage controller: handle legacy TenantConf in consistency_check (#10422) John Spray 2025-01-16 16:56:44 +00:00
  • c19a16792a address nit ; https://github.com/neondatabase/neon/pull/10386#discussion_r1918782034 Christian Schwarz 2025-01-16 17:54:14 +01:00
  • ed189d733f Merge branch 'main' into 22037-basic-fast-import-e2e Gleb Novikov 2025-01-16 16:46:53 +00:00
  • cf75eb7d86 Revert "hacky experiment: what if we had more walredo procs => doesn't move the needle on throughput" Christian Schwarz 2025-01-16 16:46:49 +01:00
  • 6ededa17e2 Revert "experiment: buffered socket with 128k buffer size; not super needle-moving" Christian Schwarz 2025-01-16 16:42:10 +01:00
  • 7e13e5fc4a experiment: buffered socket with 128k buffer size; not super needle-moving Christian Schwarz 2025-01-16 16:41:47 +01:00
  • 45358bcb65 in the deepl_layers_with_delta script, make the stack height an argument Christian Schwarz 2025-01-16 16:41:15 +01:00
  • 652479cf62 pageserver: update doc comments referencing renamed types jcsp/sharding-rename John Spray 2025-01-16 15:38:34 +00:00
  • cccc196848 refactor(pageserver): make partitioning an ArcSwap (#10377) Alex Chi Z. 2025-01-16 10:33:37 -05:00
  • b82f037ab1 pageserver: rename TenantsMap -> TenantShardMap John Spray 2025-01-16 15:22:53 +00:00
  • fa96b758bc pageserver: rename TenantManager -> TenantShardManager John Spray 2025-01-16 15:22:17 +00:00
  • ecfe76865b pageserver: rename TenantHarness -> TenantShardHarness John Spray 2025-01-16 15:20:48 +00:00
  • 2fa492943a pageserver: rename Tenant to TenantShard John Spray 2025-01-16 15:19:15 +00:00
  • e436dcad57 Rename "disabled" safekeeper scheduling policy to "pause" (#10410) Arpad Müller 2025-01-16 15:30:49 +01:00
  • 1ffd697090 forgot semicolon BodoBolero 2025-01-16 15:20:53 +01:00
  • 21d7b6a258 tests: refactor test_tenant_delete_races_timeline_creation (#10425) John Spray 2025-01-16 14:11:33 +00:00
  • 9fffe6e60d hacky experiment: what if we had more walredo procs => doesn't move the needle on throughput Christian Schwarz 2025-01-16 13:58:23 +01:00
  • 2ff0a4ae82 extract the l0stack generator into a reusable python module Christian Schwarz 2025-01-16 13:07:55 +01:00
  • d6a4896070 use correct contrib sql file BodoBolero 2025-01-16 10:33:12 +01:00
  • 3e84dfb620 Merge branch 'main' into alexk/add-pg_duckdb Peter Bendel 2025-01-16 10:21:11 +01:00
  • 86dbc44db1 CI: Run check-codestyle-rust as part of pre-merge-checks (#10387) JC Grünhage 2025-01-16 10:20:24 +01:00
  • 1ae0ab2554 in Neon we don't allow superuser so we need to grant some superuser only functions to neon_superuser BodoBolero 2025-01-16 10:17:37 +01:00
  • 58f6af6c9a Clean up compute_ctl extension server code (#10417) Tristan Partin 2025-01-16 02:35:36 -06:00
  • 7be971081a Make sure we request pages with a known-flushed LSN. (#10413) Matthias van de Meent 2025-01-16 09:34:11 +01:00
  • c91905e643 Merge pull request #10416 from neondatabase/rc/release-proxy/2025-01-16 release-proxy-7328 Ivan Efremov 2025-01-16 10:04:38 +02:00
  • 6fe4c6798f Add START_WAL_PUSH proto_version and allow_timeline_creation options. (#10406) Arseny Sher 2025-01-16 11:01:19 +03:00
  • 44b4e355a2 Proxy release 2025-01-16 github-actions[bot] 2025-01-16 06:02:04 +00:00
  • 2eda484ef6 prefetch: Read more frequently from TCP buffer (#10394) Matthias van de Meent 2025-01-16 03:43:47 +01:00
  • c7429af8a0 Enable dblink (#10358) Mikhail Kot 2025-01-15 22:29:18 +00:00
  • a753349cb0 feat(pageserver): validate data integrity during gc-compaction (#10131) Alex Chi Z. 2025-01-15 17:04:06 -05:00
  • 55a68b28a2 fast import: restore to neondb (not postgres) database (#10251) Gleb Novikov 2025-01-15 20:51:09 +00:00
  • 66c0df8109 doc comment on BatchedFeMessage explaining WeakHandle; https://github.com/neondatabase/neon/pull/10386#discussion_r1916968951 Christian Schwarz 2025-01-15 21:49:26 +01:00
  • 9fe77c527f inline get_impl; https://github.com/neondatabase/neon/pull/10386#discussion_r1916939623 Christian Schwarz 2025-01-15 21:47:39 +01:00