Commit Graph

  • b7af2c5124 [PRE-MERGE] pageserver: add force flag for awaiting logical size Vlad Lazar 2024-01-08 17:56:09 +00:00
  • 71beabf82d Join multiline postgres logs in compute_ctl (#5903) Arthur Petukhovsky 2024-01-10 19:11:43 +04:00
  • 8a3979ce34 Revert "Revert "revert recent VirtualFile asyncification changes (#5291)"" Christian Schwarz 2024-01-10 15:01:49 +00:00
  • 76372ce002 Added auth info cache with notifiations to redis. (#6208) Anna Khanova 2024-01-10 12:51:05 +01:00
  • d6598e0315 Revert "revert recent VirtualFile asyncification changes (#5291)" Christian Schwarz 2024-01-09 18:39:38 +00:00
  • 5ec8e1a6fe fixup 'pagebench: getpage: better logging about when load starts & cancellation' Christian Schwarz 2024-01-10 11:27:36 +00:00
  • 4dd33718e5 compaction: avoid no-op timeline dir fsync Christian Schwarz 2024-01-10 10:41:09 +00:00
  • 69eafb56eb pagebench: getpage: better logging about when load starts & cancellation Christian Schwarz 2024-01-09 19:34:20 +00:00
  • 248d4d6b31 pagebench: optional keyspace cache file Christian Schwarz 2024-01-09 19:07:57 +00:00
  • afcb924bab Revert "Revert "revert recent VirtualFile asyncification changes (#5291)"" problame/revert-revert-virtualfile-asyncification/2024-01-09--01 Christian Schwarz 2023-12-11 13:41:34 +00:00
  • fd14773bfc persist benchmarked config Christian Schwarz 2023-12-08 13:29:30 +00:00
  • d8c90ea659 page cache: improve eviction-related metrics Christian Schwarz 2023-12-08 12:17:42 +00:00
  • 79a4ee938b Revert "revert recent VirtualFile asyncification changes (#5291)" Christian Schwarz 2023-11-08 12:36:34 +00:00
  • ebcdd758eb test results Christian Schwarz 2023-11-29 18:36:38 +00:00
  • c61d27c18d improve instructions Christian Schwarz 2023-11-29 16:10:54 +00:00
  • 3bb58f78f0 usage instructions for generator script Christian Schwarz 2023-11-28 15:23:34 +00:00
  • c12af4ea58 many_tenants script now works Christian Schwarz 2023-11-27 16:11:05 +00:00
  • 2c4d2e9d7e update many tenants script to use the new method for duplicating tenants (copy-paste from benchmarking WIP PR) Christian Schwarz 2023-11-27 15:12:27 +00:00
  • 2043221fca Squashed commit of the following: Christian Schwarz 2023-11-27 15:00:51 +00:00
  • bf40845db4 measured BACKGROUND_RUNTIME performance using wrk Christian Schwarz 2023-08-31 07:59:21 +00:00
  • 44f885f444 HACK: BACKGROUND_RUNTIME webserver to measure response time using wrk Christian Schwarz 2023-08-31 07:49:30 +00:00
  • eb679d4b27 REPRO the problem: , uses 430GB of space; 4 seconds load time; constant 20kIOPS after ~20s Christian Schwarz 2023-08-27 16:53:14 +00:00
  • 4e1b0b84eb pagebench: fixup after is_rel_block_key changes in #6266 (#6303) Christian Schwarz 2024-01-09 19:00:37 +01:00
  • 77efb8b58b many_tenants: fix: waiting for all tenants to become active doesn't work with 20k tenants Christian Schwarz 2024-01-09 16:15:14 +00:00
  • 8c855f4e1f many_tenants: create the snapshot using overlayfs if supported Christian Schwarz 2024-01-09 15:25:22 +00:00
  • a2febc5a90 python tests: NeonEnv: extract shutting down of child processes into a NeonEnv.stop() method Christian Schwarz 2024-01-09 15:22:40 +00:00
  • 7675d10588 partial ruff format Christian Schwarz 2024-01-09 15:21:59 +00:00
  • 47f90895d1 Merge remote-tracking branch 'origin/main' into problame/benchmarking/pr/python-perftest Christian Schwarz 2024-01-09 15:18:41 +00:00
  • 2c9b3c941c python tests: broker: support stopping using SIGKILL Christian Schwarz 2024-01-09 15:11:03 +00:00
  • 9bdbca0c02 neon_local init: add --force mode that allows an empty dir Christian Schwarz 2024-01-09 15:08:54 +00:00
  • 7721f1b9c6 work_queue: detect exception raise in work_fn Christian Schwarz 2024-01-09 15:04:46 +00:00
  • f94abbab95 pageserver: clean up a redundant tenant_id attribute (#6280) John Spray 2024-01-09 12:10:15 +00:00
  • 4b9b4c2c36 pageserver: cleanup redundant create/attach code, fix detach while attaching (#6277) John Spray 2024-01-09 10:37:54 +00:00
  • 8186f6b6f9 Drop async_trait usage from three internal traits (#6305) Arpad Müller 2024-01-09 11:20:08 +01:00
  • 90e0219b29 python tests: support overlayfs for NeonEnvBuilder.from_repo_dir (#6295) Christian Schwarz 2024-01-09 11:15:46 +01:00
  • af270a2ba0 more progress logging Christian Schwarz 2024-01-09 09:47:12 +00:00
  • 5f4fe8f72a fight various timeouts at high tenant count Christian Schwarz 2024-01-09 09:45:37 +00:00
  • ad130f831a walingest: log a warning once per process upon unknown record Christian Schwarz 2024-01-05 10:14:33 +00:00
  • 4b6004e8c9 fix(page_service client): correctly deserialize pagestream errors (#6302) Christian Schwarz 2024-01-09 10:22:43 +01:00
  • 9bf7664049 vm-monitor: Remove spammy log line (#6284) Em Sharnoff 2024-01-08 21:12:39 -08:00
  • d5e3434371 Also allow unnecessary_fallible_conversions lint (#6294) Arpad Müller 2024-01-09 05:22:36 +01:00
  • 89fe8cb60b log timing of keyspace filtering Christian Schwarz 2024-01-08 19:16:56 +00:00
  • 3ce7c6ffcb fix(page_service client): correctly deserialize pagestream errors Christian Schwarz 2024-01-08 19:00:04 +00:00
  • 1a81eeaceb pagebench: fixup after is_rel_block_key changes in #6266 Christian Schwarz 2024-01-08 18:30:14 +00:00
  • 52e1d5605f work_queue abstraction: typing fixes Christian Schwarz 2024-01-08 18:29:29 +00:00
  • 587493dbe1 many_tenants: logging Christian Schwarz 2024-01-08 17:25:19 +00:00
  • 66c52a629a RFC: vectored Timeline::get (#6250) Christian Schwarz 2024-01-08 16:00:01 +01:00
  • d9586e27fd Merge remote-tracking branch 'origin/main' into problame/benchmarking/pr/python-perftest Christian Schwarz 2024-01-08 14:24:32 +00:00
  • 8a646cb750 proxy: add request context for observability and blocking (#6160) Conrad Ludgate 2024-01-08 11:42:43 +00:00
  • a4ac8e26e8 Update Rust to 1.75.0 (#6285) Arpad Müller 2024-01-08 11:46:16 +01:00
  • aa72a22661 Release 2024-01-08 (#6286) release-4525 vipvap 2024-01-08 09:26:27 +00:00
  • b3a681d121 s3_scrubber: updates for sharding (#6281) John Spray 2024-01-08 09:19:10 +00:00
  • b5ed6f22ae pageserver: clean up a TODO comment (#6282) John Spray 2024-01-08 09:19:00 +00:00
  • 5c0264b591 Merge branch 'release' into releases/2024-01-08 Shany Pozin 2024-01-08 09:34:06 +02:00
  • d1c0232e21 pageserver: use pub(crate) in metrics.rs, and clean up unused items (#6275) John Spray 2024-01-08 03:53:15 +00:00
  • f756b374c7 WIP diesel for persistence jcsp/attachment-service-v5 John Spray 2024-01-07 22:12:38 +00:00
  • a1c1c1e747 wip John Spray 2024-01-07 20:53:20 +00:00
  • 7c3d2f0c61 wip reconciliation John Spray 2024-01-07 20:14:51 +00:00
  • 53c87cdb92 wip persistence John Spray 2024-01-07 20:13:27 +00:00
  • bbdd27a522 tests: avoid using "create tenant" as a metric test John Spray 2024-01-04 18:23:02 +00:00
  • e0cd0fac0d control_plane: selectively pass through timeline create errors John Spray 2024-01-04 17:51:31 +00:00
  • ac12b7b45e control_plane: use mgmt_api::Error in client John Spray 2024-01-04 17:51:16 +00:00
  • 8da1034b8f tests: update test_broken_timeline to hit HTTP API directly John Spray 2024-01-04 16:56:12 +00:00
  • 62e48e9ebd control_plane, tests: enable running compute with explicit pageserver John Spray 2024-01-04 14:29:14 +00:00
  • 4a97058239 tests: update generations tests John Spray 2024-01-04 14:28:33 +00:00
  • 0c85cd3766 tests: use auth tokens for attachment service John Spray 2024-01-04 14:06:40 +00:00
  • 5ae1efaea8 pageserver_api: make ShardIdentity::stripe_size public John Spray 2024-01-03 15:33:40 +00:00
  • 502504d0ad pageserver_api: enrich types for use in reconciler John Spray 2024-01-03 15:31:47 +00:00
  • 30a46df7da tests: fix type decorations on helpers John Spray 2024-01-02 16:59:21 +00:00
  • fa6ffa1782 pageserver: enrich a remote client log message John Spray 2024-01-02 14:28:14 +00:00
  • 078f8f955d tests: update restart+regress tests to use sharding John Spray 2024-01-02 14:27:14 +00:00
  • e83c793c54 test: add test_sharding John Spray 2024-01-02 14:27:08 +00:00
  • 02c00b1418 compute_api: add shard_stripe_size to ComputeSpec John Spray 2024-01-02 14:23:13 +00:00
  • 55939ef897 test: update fixtures for sharding/attachment service John Spray 2024-01-02 14:21:52 +00:00
  • 7183c5719b utils: implement FromStr for NodeId John Spray 2024-01-02 13:26:07 +00:00
  • 6a72fdc5d8 control_plane: major rework of attachment_service John Spray 2024-01-02 13:12:26 +00:00
  • 10519937e6 pageserver/client: update APIs for sharding John Spray 2024-01-02 13:10:30 +00:00
  • b63ba61da1 pageserver: refactor creation API (add ShardParams) John Spray 2023-12-07 14:57:15 +00:00
  • af844571e6 pageserver: only upload initdb from shard 0 John Spray 2023-12-22 14:04:08 +00:00
  • 6f4d1daaec pageserver_api: accomodate TenantShardId in location conf John Spray 2024-01-03 14:47:32 +00:00
  • 11d97ea65d pageserver_api: add a public version of TenantHistorySize John Spray 2024-01-03 14:45:31 +00:00
  • 214c01b498 pageserver/mgmt_api: include status in API errors John Spray 2024-01-04 16:55:47 +00:00
  • 0a2e90ab65 pageserver: move EvictionPolicy into models/ John Spray 2024-01-07 20:57:42 +00:00
  • 8bd0fc4dd1 Support sharding at compute side Konstantin Knizhnik 2023-12-20 21:04:14 +02:00
  • a41c4122e3 Don't suspend compute if there is active LR subscriber. Arseny Sher 2024-01-04 01:21:33 +03:00
  • fbcb1268bf extract work queue and use it to drive broken attach in parallel Christian Schwarz 2024-01-05 19:10:41 +00:00
  • 392e014a7f reuable abstraction for many tenants fixture Christian Schwarz 2024-01-05 18:08:59 +00:00
  • dd69927953 do the on-demand downloads in Python, it's faster; plus some cleanups and renamings Christian Schwarz 2024-01-05 17:34:06 +00:00
  • 7de829e475 test_runner: replace black with ruff format (#6268) Alexander Bayandin 2024-01-05 15:35:07 +00:00
  • 838a6d304d test_snapshot_dir fixture with marker file for finished snapshot Christian Schwarz 2024-01-05 13:41:12 +00:00
  • 72da46dd5a improve overlayfs cleanup code Christian Schwarz 2024-01-05 12:33:17 +00:00
  • 3c560d27a8 pageserver: implement secondary-mode downloads (#6123) John Spray 2024-01-05 12:29:20 +00:00
  • a748d67915 add support to use overlayfs in from_root_dir Christian Schwarz 2024-01-05 12:15:01 +00:00
  • 857eabc812 include downloaded layers in snapshot Christian Schwarz 2024-01-05 10:57:14 +00:00
  • d260426a14 is_rel_block_key: exclude the relsize key (#6266) Christian Schwarz 2024-01-05 11:48:06 +01:00
  • f3b5db1443 Add API for safekeeper timeline copy (#6091) Arthur Petukhovsky 2024-01-04 21:40:38 +04:00
  • 4a7ea3f533 [PRE-MERGE] hlinnaka/walingest-simplify-vm-flag-clearing-2 Squashed commit of the following: problame/walingest-decoding-exhaustiveness-refs-iss-5962 Christian Schwarz 2024-01-04 17:08:24 +00:00
  • c029203d47 [PRE-MERGE] walingest/walredo: simplify Visibility Map flag clearing code #6271 + manual work Christian Schwarz 2024-01-04 16:46:52 +00:00
  • b1d701dc06 Refactor generation of ClearVisibilityMapFlags records. hlinnaka/walingest-simplify-vm-flag-clearing-2 Heikki Linnakangas 2024-01-04 18:23:59 +02:00
  • aa95a07d27 Refactor code to apply ClearVisibilityMapFlags records a little. Heikki Linnakangas 2024-01-04 18:20:03 +02:00