Commit Graph

  • bd5cb9e86b Implement timeline_manager for safekeeper background tasks (#7768) Arthur Petukhovsky 2024-05-22 09:34:39 +01:00
  • 00d66e8012 compute_ctl: Fix handling of missing /neonvm/bin/resize-swap (#7832) Em Sharnoff 2024-05-21 16:52:48 -07:00
  • 679e031cf6 Add dummy lsn lease http and page service APIs (#7815) Arpad Müller 2024-05-21 23:31:20 +02:00
  • e3f6a07ca3 chore(pageserver): remove metrics for in-memory ingestion (#7823) Alex Chi Z 2024-05-21 13:33:29 -04:00
  • 496e96cdff Update pageserver/src/tenant.rs skyzh/rm-aux-v1-keyspace Alex Chi Z 2024-05-21 13:32:57 -04:00
  • a8a88ba7bc test(detach_ancestor): ensure L0 compaction in history is ok (#7813) Joonas Koivunen 2024-05-21 20:08:43 +03:00
  • 025a183091 safekeeper: use CancellationToken instead of watch channel jcsp/sk-concurrency-primitives John Spray 2024-05-21 17:51:43 +01:00
  • baedfc90b5 safekeeper: use a Gate in Timeline to order shutdown John Spray 2024-05-21 17:38:04 +01:00
  • 63db18101e feat(pageserver): remove aux v1 keyspace if user fully switches to v2 Alex Chi Z 2024-05-21 11:21:23 -04:00
  • 353afe4fe7 neon_local: run controller's postgres with fsync=off (#7817) John Spray 2024-05-21 16:13:54 +01:00
  • 1988ad8db7 Extend test_unlogged to include a sequence Tristan Partin 2024-05-17 13:42:51 -05:00
  • e3415706b7 Upgrade Postgres v16 to 16.3 Tristan Partin 2024-05-20 10:04:04 -05:00
  • 9d081851ec Upgrade Postgres v15 to 15.7 Tristan Partin 2024-05-20 10:03:09 -05:00
  • 781352bd8e Upgrade Postgres v14 to 14.12 Tristan Partin 2024-05-20 10:01:58 -05:00
  • 8030b8e4c5 Fix test_pg_regress for unlogged relations Tristan Partin 2024-05-17 13:56:02 -05:00
  • 9a4b896636 Use a constant for database name in test_pg_regress Tristan Partin 2024-05-17 13:50:36 -05:00
  • e8b8ebfa1d Allow check_restored_datadir_content to ignore certain files Tristan Partin 2024-05-17 13:39:33 -05:00
  • d9d471e3c4 Add some Python typing in a few test files Tristan Partin 2024-05-14 13:49:04 -05:00
  • 9519f06d48 Add context to broker pull. Arseny Sher 2024-05-21 17:13:41 +03:00
  • 6e17c359bd Fix logging when backup task is stopped. Arseny Sher 2024-05-21 17:13:07 +03:00
  • d43dcceef9 Minimize hot standby feedback xmins to next_xid. Arseny Sher 2024-05-20 18:41:39 +03:00
  • f2771a99b7 Add metric for pageserver standby horizon. Arseny Sher 2024-05-20 14:28:36 +03:00
  • f54c3b96e0 Fix bugs in hot standby feedback propagation and add test for it. Arseny Sher 2024-05-21 14:42:25 +03:00
  • 478cc37a70 Propagate standby apply LSN to pageserver to hold off GC. Arseny Sher 2024-05-21 14:32:29 +03:00
  • 4ce6e2d2fc pageserver: fix secondary progress stats when layers are 404 (#7814) John Spray 2024-05-21 13:46:04 +01:00
  • baeb58432f build(deps): bump requests from 2.31.0 to 2.32.0 (#7816) dependabot[bot] 2024-05-21 10:48:17 +00:00
  • 6f3e043a76 Add some more replication slot metrics (#7761) Sasha Krassovsky 2024-05-20 17:00:47 -07:00
  • a40eee31a7 refactor(pageserver): better k-merge implementation for tiered compaction skyzh/k-merge-impl Alex Chi Z 2024-05-14 12:17:05 -04:00
  • 6810d2aa53 feat(pageserver): do not read past image layers for vectored get (#7773) Alex Chi Z 2024-05-20 14:24:18 -04:00
  • 2d7091871f Update banner image in Readme (#7801) Andy Hattemer 2024-05-20 12:15:43 -04:00
  • 7701ca45dd feat(pageserver): generate image layers for sparse keyspace (#7567) Alex Chi Z 2024-05-20 12:08:45 -04:00
  • 78459aee43 Add manager comment Arthur Petukhovsky 2024-05-20 12:58:01 +00:00
  • 81dbfc33c2 Fix cargo doc Arthur Petukhovsky 2024-05-17 17:04:33 +00:00
  • 7771275cc6 Add metrics Arthur Petukhovsky 2024-05-17 16:30:27 +00:00
  • 86453b422d Add comments Arthur Petukhovsky 2024-05-16 23:58:32 +00:00
  • 35d6599278 Do self review Arthur Petukhovsky 2024-05-16 22:54:28 +00:00
  • e8d0956cf7 Fix WAL_BACKUP_RUNTIME usage Arthur Petukhovsky 2024-05-16 22:18:06 +00:00
  • 053ada80b2 Implement TimelineSet for storing active timelines Arthur Petukhovsky 2024-05-16 15:01:05 +00:00
  • 75801f0451 Refactor backup launcher into timeline manager Arthur Petukhovsky 2024-05-15 12:55:43 +00:00
  • de8dfee4bd safekeeper: log LSNs on walreceiver/walsender exit. Arseny Sher 2024-05-13 13:19:12 +03:00
  • e3f51abadf safekeeper: close connection when COPY stream ends. Arseny Sher 2024-05-13 13:18:18 +03:00
  • fc538a38b9 Merge pull request #7807 from neondatabase/rc/2024-05-20 release-5545 Arthur Petukhovsky 2024-05-20 12:16:00 +01:00
  • a7b84cca5a Upgrade of pgvector to 0.7.0 (#7726) Peter Bendel 2024-05-20 12:07:25 +02:00
  • 291fcb9e4f pageserver: use the heatmap upload interval to set the secondary download interval (#7793) John Spray 2024-05-20 09:25:25 +01:00
  • a5ecca976e proxy: bump parquet (#7782) Conrad Ludgate 2024-05-19 20:45:53 +01:00
  • 5caee4ca54 Fix calculation in test Heikki Linnakangas 2024-05-19 20:49:49 +03:00
  • 8dc1c48605 Fix race condition in XLogWaitForReplayOf() fix-XLogWaitForReplayOf-race Heikki Linnakangas 2024-05-19 21:07:29 +03:00
  • 0a0e8348aa Update lwlsn for replica too in neon_wallog_page not_modified_since_fix Konstantin Knizhnik 2024-05-18 15:01:07 +03:00
  • e1a9669d05 feat(pagebench): add aux file bench (#7746) Alex Chi Z 2024-05-17 16:04:02 -04:00
  • aaf60819fa feat(pageserver): persist aux file policy in index part (#7668) Alex Chi Z 2024-05-17 15:22:49 -04:00
  • c84656a53e pageserver: implement auto-splitting (#7681) John Spray 2024-05-17 17:01:24 +01:00
  • af99c959ef storage controller: use SERIALIZABLE isolation level (#7792) John Spray 2024-05-17 16:44:33 +01:00
  • d72aac0ad8 Set result.not_modified_since as minimum of last_written_lsn and replay lsn Konstantin Knizhnik 2024-05-17 17:17:52 +03:00
  • a8e6d259cb pageserver: fixes for layer path changes (#7786) John Spray 2024-05-17 13:24:03 +01:00
  • c1390bfc3b chore: update defaults for timeline_detach_ancestor (#7779) Joonas Koivunen 2024-05-17 13:25:01 +03:00
  • 6d951e69d6 test_suite: patch, don't replace, the tenant_config field, where appropriate (#7771) Christian Schwarz 2024-05-17 12:24:02 +02:00
  • 4b8809b280 Tiered compaction: improvements to the windows (#7787) Arpad Müller 2024-05-16 22:25:19 +02:00
  • 4c5afb7b10 Remove SSO_ACCOUNT_ID from scrubber docs and BucketConfig (#7774) Arpad Müller 2024-05-16 19:35:13 +02:00
  • 82bf77c1ae tests: tune test_sharding_autosplit jcsp/issue-7488-auto-split-test John Spray 2024-05-16 17:37:52 +01:00
  • ec069dc45e tiered compaction: introduce PAGE_SZ constant and use it (#7785) Arpad Müller 2024-05-16 16:48:49 +02:00
  • 790c05d675 proxy: swap tungstenite for a simpler impl (#7353) Conrad Ludgate 2024-05-16 12:05:50 +01:00
  • 923cf91aa4 compute_ctl: catalog API endpoints (#7575) Andrew Rudenko 2024-05-16 12:04:16 +02:00
  • 272416a29c improve comments in identify_levels Heikki Linnakangas 2024-05-16 12:25:21 +03:00
  • 122c89f98b Merge remote-tracking branch 'upstream/main' into jcsp/issue-7488-auto-split John Spray 2024-05-16 10:21:18 +01:00
  • 24d137a524 simplify get_sizes John Spray 2024-05-16 10:19:05 +01:00
  • 94b4d3cc78 tests: make pgbench parsing work with pg14 John Spray 2024-05-16 10:07:03 +01:00
  • 95967f07b3 tests: ad test_top_tenants John Spray 2024-05-16 09:40:51 +01:00
  • af24b63cd3 s/top_n/top/ John Spray 2024-05-16 09:26:55 +01:00
  • df8d888d90 use BinaryHeap John Spray 2024-05-16 09:22:01 +01:00
  • 03c6039707 pageserver: refine tenant_id->shard lookup (#7762) John Spray 2024-05-16 09:26:34 +01:00
  • 6593ce05b8 reprpducer: identify_levels bails too early problame/tiered-compaction/identify-levels-bails-too-early Christian Schwarz 2024-05-15 22:31:16 +00:00
  • c4b0ecec33 pageserver: reduce usage of TENANTS jcsp/tenant-mgr-refs John Spray 2024-05-15 20:56:17 +01:00
  • a5565cc641 pageserver: pull get_active_tenant_with_timeout into TenantManager John Spray 2024-05-15 20:49:16 +01:00
  • 1804abd23d pageserver: pass a TenantManager into page service John Spray 2024-05-15 20:45:31 +01:00
  • c6d5ff944d fix(test): ensure fixtures are correctly used for pageserver_aux_file_policy (#7769) rc/proxy/2024-05-16 Alex Chi Z 2024-05-15 14:29:12 -04:00
  • 4b97683338 feat(pageserver): use fnv hash for aux file encoding (#7742) Alex Chi Z 2024-05-15 13:17:57 -04:00
  • 0d4247d2d8 fix a weird variable name John Spray 2024-05-15 18:14:10 +01:00
  • b968ae0aa8 make a comment clearer John Spray 2024-05-15 18:13:37 +01:00
  • affc18f912 Add performance regress test_ondemand_download_churn.py (#7242) Jure Bajic 2024-05-15 18:41:12 +02:00
  • 3ef6e21211 fixup #7747: actually use the fixture for neon_env_builder (#7767) Christian Schwarz 2024-05-15 18:17:55 +02:00
  • 1075386d77 Add test_uploads_and_deletions test (#7758) Arpad Müller 2024-05-15 15:32:47 +02:00
  • c3dd646ab3 chore!: always use async walredo, warn if sync is configured (#7754) Christian Schwarz 2024-05-15 15:04:52 +02:00
  • bc78b0e9cc chore(deps): use upstream svg_fmt after they merged our PR (#7764) Christian Schwarz 2024-05-15 14:18:02 +02:00
  • f342b87f30 pageserver: remove Option<> around remote storage, clean up metadata file refs (#7752) John Spray 2024-05-15 13:05:24 +01:00
  • 438bacc32e CI(neon-extra-builds): Use small-arm64 runners instead of large-arm64 (#7740) Alexander Bayandin 2024-05-15 12:29:12 +01:00
  • bc5c2d00cb tests: add test_sharding_autosplit John Spray 2024-05-09 16:06:10 +01:00
  • 1a2a3cb446 Add restart_lsn metric for logical slots. Arseny Sher 2024-05-10 16:23:36 +03:00
  • e0871a49f4 neon_local: enable configuring split_threshold John Spray 2024-05-08 20:02:49 +01:00
  • c2e1b9d94b Avoid Mutex around physical size metric John Spray 2024-05-13 18:29:17 +01:00
  • eb732d38aa storage_controller: add auto-splitting John Spray 2024-05-08 17:01:50 +01:00
  • e28122326c pageserver: add "top N" API John Spray 2024-05-08 17:01:37 +01:00
  • f901cd459b pageserver: refine tenant_id->shard lookup John Spray 2024-05-14 22:07:14 +01:00
  • 4eedb3b6f1 test suite: allow overriding default compaction algorithm via env var (#7747) Christian Schwarz 2024-05-14 18:03:08 +02:00
  • e67fcf9563 Update mold to 2.31 (#7757) Arpad Müller 2024-05-14 17:49:19 +02:00
  • 82960b2175 pageserver: skip waiting for logical size on shard >0 (#7744) John Spray 2024-05-14 16:39:17 +01:00
  • 30d15ad403 chore(test): add version check for forward compat test (#7685) Alex Chi Z 2024-05-14 10:36:48 -04:00
  • b6ee91835b CI(report-benchmarks-failures): fix condition (#7745) Alexander Bayandin 2024-05-14 11:39:59 +01:00
  • df0f1e359b pageserver: switch on new-style local layer paths (#7660) John Spray 2024-05-14 09:37:48 +01:00
  • cd0e344938 pageserver: do fewer heatmap uploads for tiny tenants (#7731) John Spray 2024-05-14 09:31:26 +01:00
  • 22afaea6e1 Always use Lsn::MAX as the request LSN in the primary (#7708) Heikki Linnakangas 2024-05-13 13:17:30 +03:00