Commit Graph

  • b809391892 Replace cachepot with sccache Alexander Bayandin 2024-01-26 17:14:33 +00:00
  • a37b8c58bf More potential test fixes Matthias van de Meent 2024-06-28 21:08:03 +02:00
  • cd4fdd75d8 Make sure we only delete a tenant we've created. Matthias van de Meent 2024-06-28 17:37:48 +02:00
  • b237e83c0e Style fixes Matthias van de Meent 2024-06-28 16:50:35 +02:00
  • 4ab2b8f575 Implement testing, and add a call to cleanup that I'd missed. Matthias van de Meent 2024-06-28 16:42:53 +02:00
  • 088a743d39 Handle PS error responses cleanly Matthias van de Meent 2024-06-27 10:58:15 +02:00
  • bc704917a3 fix(pageserver): ensure tenant harness has different names (#8205) Alex Chi Z 2024-06-28 15:13:25 -04:00
  • b8bbaafc03 storage controller: fix heatmaps getting disabled during shard split (#8197) John Spray 2024-06-28 18:27:13 +01:00
  • e1a06b40b7 Add rate limiter for partial uploads (#8203) Arthur Petukhovsky 2024-06-28 18:16:21 +01:00
  • babbe125da pageserver: drop out of secondary download if iteration time has passed (#8198) John Spray 2024-06-28 18:05:09 +01:00
  • 37c1f5898d tests: add migrate under load test jcsp/shutdown-under-load-test John Spray 2024-06-26 13:17:33 +00:00
  • 895ecef318 pageserver: suppress layer download warnings during shutdown John Spray 2024-06-26 13:08:59 +00:00
  • ca2f7d06b2 Cherry-pick upstream fix for TruncateMultiXact assertion (#8195) Heikki Linnakangas 2024-06-28 16:47:05 +03:00
  • c22c6a6c9e Add buckets to safekeeper ops metrics (#8194) Arthur Petukhovsky 2024-06-28 11:09:11 +01:00
  • deec3bc578 virtual_file: take a Slice in the read APIs, eliminate read_exact_at_n, fix UB for engine std-fs (#8186) Christian Schwarz 2024-06-28 11:20:37 +02:00
  • 063553a51b pageserver: remove tenant create API (#8135) John Spray 2024-06-28 09:14:19 +01:00
  • 4c78a5067f compress cache key compress-proxy-node-cache Conrad Ludgate 2024-06-28 09:12:18 +01:00
  • 108f08f982 proxy: cache a compressed version of the node info Conrad Ludgate 2024-06-28 09:04:54 +01:00
  • 5700233a47 Add application_name to compute activity monitor connection string Tristan Partin 2024-06-27 10:27:56 -05:00
  • 1d66ca79a9 Improve slow operations observability in safekeepers (#8188) Arthur Petukhovsky 2024-06-27 18:39:43 +01:00
  • 23827c6b0d feat(pageserver): add delta layer iterator (#8064) Alex Chi Z 2024-06-27 12:03:48 -04:00
  • 66b0bf41a1 fix: shutdown does not kill walredo processes (#8150) Christian Schwarz 2024-06-27 15:58:28 +02:00
  • 89cf8df93b stocon: bump number of concurrent reconciles per operation (#8179) Vlad Lazar 2024-06-27 14:16:41 +01:00
  • 54a06de4b5 CI: Use runner.arch in cache keys along with runner.os (#8175) Alexander Bayandin 2024-06-27 13:56:03 +01:00
  • 6f20a18e8e Allow to change compute safekeeper list without restart. Arseny Sher 2024-06-17 16:23:07 +03:00
  • d557002675 strocon: don't overcommit when making node fill plan (#8171) Vlad Lazar 2024-06-27 11:56:57 +01:00
  • cfb03d6cf0 Merge pull request #8178 from neondatabase/rc/proxy/2024-06-27 release-proxy-5804 Conrad Ludgate 2024-06-27 11:35:30 +01:00
  • d81ef3f962 Revert "proxy: update tokio-postgres to allow arbitrary config params (#8076)" Conrad Ludgate 2024-06-27 09:46:58 +01:00
  • 32b75e7c73 CI: additional trigger on merge to main (#8176) Cihan Demirci 2024-06-26 23:36:41 +01:00
  • d2753719e3 test: Add helper function for importing a Postgres cluster (#8025) Heikki Linnakangas 2024-06-27 00:54:29 +03:00
  • 04b2ac3fed test: use aux file v2 policy in benchmarks (#8174) Alex Chi Z 2024-06-26 16:33:15 -04:00
  • c39d5b03e8 pageserver: remove legacy tenant config code, clean up redundant generation none/broken usages (#7947) John Spray 2024-06-26 20:53:59 +01:00
  • 76fc3d4aa1 Evict WAL files from disk (#8022) Arthur Petukhovsky 2024-06-26 18:58:56 +01:00
  • dd3adc3693 docker: downgrade openssl to 1.1.1w (#8168) Vlad Lazar 2024-06-26 18:27:23 +01:00
  • 5b871802fd Add counters for commands processed through the libpq page service API (#8089) Heikki Linnakangas 2024-06-26 19:53:03 +03:00
  • 24ce73ffaf Silence compiler warning (#8153) Heikki Linnakangas 2024-06-26 19:19:27 +03:00
  • 3118c24521 Panic on unexpected error in simtests (#8169) Arthur Petukhovsky 2024-06-26 16:46:14 +01:00
  • 5af9660b9e CI(build-tools): don't install Postgres 14 (#6540) Alexander Bayandin 2024-06-26 16:37:04 +01:00
  • d7e349d33c proxy: report blame for passthrough disconnect io errors (#8170) Conrad Ludgate 2024-06-26 16:11:26 +01:00
  • 47e5bf3bbb Improve term reject message in walproposer (#8164) Arthur Petukhovsky 2024-06-26 15:26:52 +01:00
  • 5d2f9ffa89 test(bottom-most-compaction): wal apply order (#8163) Alex Chi Z 2024-06-26 09:34:41 -04:00
  • fdadd6a152 Remove primary_is_running (#8162) Heikki Linnakangas 2024-06-26 15:13:03 +03:00
  • 9b623d3a2c add commit hash to S3 object identifier for artifacts on S3 (#8161) Peter Bendel 2024-06-26 07:46:52 +02:00
  • 9b98823d61 bottom-most-compaction: use in test_gc_feedback + fix bugs (#8103) Alex Chi Z 2024-06-25 19:00:14 -04:00
  • 76864e6a2a feat(pageserver): add image layer iterator (#8006) Alex Chi Z 2024-06-25 16:49:29 -04:00
  • 6c5d3b5263 proxy fix wake compute console retry (#8141) Conrad Ludgate 2024-06-25 19:07:54 +01:00
  • cd9a550d97 clippy-deny the todo!() macro (#4340) Christian Schwarz 2024-06-25 20:03:27 +02:00
  • 07f21dd6b6 pageserver: remove attach/detach apis (#8134) John Spray 2024-06-25 17:38:06 +01:00
  • 64a4461191 Fix submodule references to match the REL_*_STABLE_neon branches (#8159) Heikki Linnakangas 2024-06-25 19:05:13 +03:00
  • 961fc0ba8f feat(pageserver): add metrics for number of valid leases after each refresh (#8147) Yuchen Liang 2024-06-25 11:43:12 -04:00
  • 9b2f9419d9 CI: upload docker cache only from main (#8157) Alexander Bayandin 2024-06-25 16:18:22 +01:00
  • 947f6da75e L0 flush: avoid short-lived allocation when checking key_range empty (#8154) Christian Schwarz 2024-06-25 17:04:44 +02:00
  • 7026dde9eb storcon: update db related dependencides (#8155) Vlad Lazar 2024-06-25 15:06:18 +01:00
  • d502313841 Fix MVCC bug with prepared xact with subxacts on standby (#8152) Heikki Linnakangas 2024-06-25 16:29:32 +03:00
  • 24a3a549c1 metrics: update measured crate to 0.22 vlad/update-measured Vlad Lazar 2024-06-25 12:58:45 +01:00
  • 554e583289 wip vlad/sanitized-build Vlad Lazar 2024-06-25 09:39:38 +01:00
  • 219e78f885 feat(pageserver): add an optional lease to the get_lsn_by_timestamp API (#8104) Yuchen Liang 2024-06-24 16:12:24 -04:00
  • c8a3b6f930 the fix: shutdown method for WalRedoManager, so the Arc<> can outlive the process problame/walredo-graceful-shutdown Christian Schwarz 2024-06-24 19:29:31 +00:00
  • 6779c908eb Revert "WIP: solution approach 1: propagate cancellationtoken from tenant" Christian Schwarz 2024-06-24 19:04:02 +00:00
  • 5202d2dc98 WIP: solution approach 1: propagate cancellationtoken from tenant Christian Schwarz 2024-06-24 19:03:30 +00:00
  • d7e0c99616 trim down the PR to just keeping track of walredo processes Christian Schwarz 2024-06-24 18:40:23 +00:00
  • 7507d137de WIP Christian Schwarz 2024-06-24 18:25:57 +00:00
  • 34f42669fa WIP Christian Schwarz 2024-06-24 17:56:36 +00:00
  • 943220df9b implement a global gate + cancellation mechanism for live walredo processes, hook up to shutdown Christian Schwarz 2024-06-24 17:18:54 +00:00
  • 1ea5d8b132 tests: accomodate some messages that can fail tests (#8144) John Spray 2024-06-24 18:03:53 +01:00
  • 3d760938e1 storcon_cli: remove old tenant-scatter command (#8127) John Spray 2024-06-24 17:57:16 +01:00
  • 5e0ef715aa add distinguished "Cancelled" error for walredo (don't use it yet) Christian Schwarz 2024-06-24 16:05:04 +00:00
  • 9211de0df7 test(pageserver): add delta records tests for gc-compaction (#8078) Alex Chi Z 2024-06-24 11:50:31 -04:00
  • d8ffe662a9 fix(pageserver): handle version number in draw timeline (#8102) Alex Chi Z 2024-06-24 11:31:06 -04:00
  • a4db2af1f0 Truncate waltmp file on creation (#8133) Arthur Petukhovsky 2024-06-24 15:07:59 +01:00
  • 47fdf93cf0 tests: fix a flake in test_sharding_split_compaction (#8136) John Spray 2024-06-24 14:54:54 +01:00
  • de05f90735 pageserver: add more info-level logging in shard splits (#8137) John Spray 2024-06-24 11:53:43 +01:00
  • 188797f048 pageserver: remove code that resumes tenant deletions after restarts (#8091) John Spray 2024-06-24 11:41:11 +01:00
  • 5446e08891 Move remote_storage config related code into dedicated module (#8132) Arpad Müller 2024-06-24 12:29:54 +02:00
  • 78d9059fc7 proxy: update tokio-postgres to allow arbitrary config params (#8076) Conrad Ludgate 2024-06-24 11:20:27 +01:00
  • 939b5954a5 Merge pull request #8138 from neondatabase/rc/2024-06-24 release-5779 John Spray 2024-06-24 10:57:45 +01:00
  • 6062cd180c proxy: skip 1rtt during auth (experiment) proxy-skip-1rtt Conrad Ludgate 2024-06-24 09:11:00 +01:00
  • 75747cdbff Use serde for RemoteStorageConfig parsing (#8126) Arpad Müller 2024-06-22 19:57:09 +02:00
  • 5e32cce2d9 Add script for plots arpad/compression_pagectl Arpad Müller 2024-06-22 18:14:05 +02:00
  • 8fe3f17c47 storcon: improve drain and fill shard placement (#8119) Vlad Lazar 2024-06-22 15:20:58 +01:00
  • 8776089c70 Remove kq_imcx extension support per customer request Anastasia Lubennikova 2024-06-21 13:51:07 +01:00
  • b74232eb4d tests: allow-list neon_local endpoint errors from storage controller (#8123) John Spray 2024-06-21 18:23:31 +01:00
  • ee3081863e storcon: implement endpoints for cancellation of drain and fill operations (#8029) Vlad Lazar 2024-06-21 17:13:51 +01:00
  • 7fcc31c625 Increase wait_lsn_timeout in test_wal_receiver.py sk-test-wal-receiver-timeout Arthur Petukhovsky 2024-06-21 15:00:50 +00:00
  • 15728be0e1 pageserver: always detach before deleting (#8082) John Spray 2024-06-21 15:39:19 +01:00
  • f45cf28247 Add eviction_state to control file (#8125) Arthur Petukhovsky 2024-06-21 13:15:02 +01:00
  • e68c43c19b DNM: rip out throttling code (the recorder's borrowing of ctx obviously breaks &mut RequestContext passing) problame/mut-request-context Christian Schwarz 2024-06-21 11:36:04 +00:00
  • b2830a48dd some easy mechanical fixes (add let mut and &mut ctx) Christian Schwarz 2024-06-21 11:25:45 +00:00
  • 8b482a8be0 download.rs: fix error 'captured variable cannot escape FnMut closure body" Christian Schwarz 2024-06-21 11:19:41 +00:00
  • 81f13e17ce layer.rs: fix error 'captured variable cannot escape FnMut closure body" Christian Schwarz 2024-06-21 09:55:40 +00:00
  • 82266a252c Allow longer timeout for starting pageserver, safe keeper and storage controller in test cases to make test cases less flaky (#8079) Peter Bendel 2024-06-21 12:36:12 +02:00
  • 59f949b4a8 pageserver: remove unused load/ignore APIs (#8122) John Spray 2024-06-21 11:02:15 +01:00
  • ba13f2a90a async closure workaround for virtual file Christian Schwarz 2024-06-21 09:44:46 +00:00
  • 630c8a9b86 cargo fmt initial Christian Schwarz 2024-06-21 09:44:59 +00:00
  • f12f31ae77 auto-replace all &RequestContext to &mut RequestContext (plus a tiny bit of manual changes) Christian Schwarz 2024-06-20 20:04:31 +00:00
  • 01399621d5 storcon: avoid promoting too many shards of the same tenant (#8099) Vlad Lazar 2024-06-21 10:19:01 +01:00
  • 0792bb6785 Add tracing for shared locks in id_lock_map (#7618) Jure Bajic 2024-06-21 10:47:04 +02:00
  • 402cb2c40a add allowed errors for leases in two tests that uses static endpoints yliang/dbg-static-endpoint-lease-request Yuchen Liang 2024-06-20 17:28:29 -04:00
  • fba409a158 avoid holding locks when a thread is sleeping Yuchen Liang 2024-06-20 16:01:41 -04:00
  • f8ac3b0e0e storcon: use attached shard counts for initial shard placement (#8061) Vlad Lazar 2024-06-20 17:32:01 +01:00