Commit Graph

  • 02ecdd137b fix: preinitialize pageserver_basebackup_query_seconds metric (#8121) Christian Schwarz 2024-06-20 17:50:43 +02:00
  • b30e80512e storcon: don't call schedule vlad/storcon-scale-test-rolling-restart Vlad Lazar 2024-06-20 14:03:08 +01:00
  • 8baaccb56c Merge branch 'main' into prepor/lsn_leasing Yuchen Liang 2024-06-20 07:58:54 -04:00
  • 964030f30e test: assert before restarts Vlad Lazar 2024-06-20 12:19:42 +01:00
  • 5d62c67e75 Merge pull request #8117 from neondatabase/rc/proxy/2024-06-20 release-proxy-5751 Conrad Ludgate 2024-06-20 11:42:35 +01:00
  • e7ec5962da tests: dump shard intent and observed states nicely Vlad Lazar 2024-06-20 11:42:07 +01:00
  • d2a6cd1182 update to neon branch Conrad Ludgate 2024-06-20 11:40:14 +01:00
  • 7e6b8abf46 tests: check consistency after fill Vlad Lazar 2024-06-20 10:59:25 +01:00
  • 79401638df remove materialized page cache (#8105) Christian Schwarz 2024-06-20 11:56:14 +02:00
  • 82af640484 test: bring back consistency checks Vlad Lazar 2024-06-20 10:33:44 +01:00
  • 0fcddc1e04 increase concurrency again problame/repro-failing-pg-regress-in-pr-8105 Christian Schwarz 2024-06-20 09:15:42 +00:00
  • 48615a4f21 tests: make storage controller scale test do rolling restart Vlad Lazar 2024-06-12 15:29:29 +01:00
  • fd4b12c598 storcon: use attached shard counts for initial shard placement Vlad Lazar 2024-06-14 11:59:46 +01:00
  • 240197d22a storcon: separate scheduling context for each tenant in fill/drain Vlad Lazar 2024-06-19 18:18:00 +01:00
  • 78b6c6dedc storcon: add transactional-ish demotion to secondary Vlad Lazar 2024-06-17 17:57:47 +01:00
  • 9bcb8796a8 review: use ShardCount::count Vlad Lazar 2024-06-19 18:31:45 +01:00
  • 3a74253bcb storcon: avoid promoting too many shards of the same tenant Vlad Lazar 2024-06-19 14:12:50 +01:00
  • 83fdc07b20 storcon: separate scheduling context for each tenant in fill/drain vlad/reset-scheduling-context Vlad Lazar 2024-06-19 18:18:00 +01:00
  • a772c2dea7 figure out what timeout is high enough Christian Schwarz 2024-06-20 10:25:30 +02:00
  • c789ec21f6 CI: miscellaneous cleanups (#8073) Alexander Bayandin 2024-06-19 19:21:09 +01:00
  • 558a57b15b CI(test-images): add dockerhub auth (#8115) Alexander Bayandin 2024-06-19 17:54:07 +01:00
  • 6ebaff3518 escaping broken? Christian Schwarz 2024-06-19 18:33:42 +02:00
  • 06f953ad21 feedback: reread connstrings Andrey Rudenko 2024-06-19 18:16:59 +02:00
  • f0e2bb79b2 tests: use semaphore instead of lock for Endpoint.running (#8112) John Spray 2024-06-19 17:07:14 +01:00
  • 429b188f85 self-review, some new todo!()s problame/pr-6002-stripped Christian Schwarz 2024-06-19 17:49:15 +02:00
  • 40a8ed28b7 Merge remote-tracking branch 'origin/main' into problame/pr-6002-stripped Christian Schwarz 2024-06-19 17:35:16 +02:00
  • eef40ce9e2 transform the deserializer manually problame/serde-deserializable-remote-storage-config Christian Schwarz 2024-05-13 18:20:46 +02:00
  • 12134b43b7 DNM: repro failing pg_regress Christian Schwarz 2024-06-19 16:21:23 +02:00
  • e67746c41c Implement new vm-monitor - controller autoscaling protocol heikki/wip-autoscale-api Heikki Linnakangas 2024-06-19 13:12:30 +03:00
  • cd77bb991d Update sysinfo crate Heikki Linnakangas 2024-06-19 12:32:56 +03:00
  • 8d8c72803a RFC: move decision-making of desired VM size to VM monitor rfc-compute-controlled-autoscaling Heikki Linnakangas 2024-06-19 16:45:19 +03:00
  • e575582fd5 storcon: add transactional-ish demotion to secondary vlad/pseudo-transactional-reschedule Vlad Lazar 2024-06-17 17:57:47 +01:00
  • b6d51d3b4a remove test https://github.com/neondatabase/neon/pull/7777#discussion_r1602986080 Christian Schwarz 2024-06-19 15:20:22 +02:00
  • 171a97ca38 Merge branch 'main' into improve-identify_levels-comments Christian Schwarz 2024-06-19 15:18:25 +02:00
  • fd0b22f5cd Make sure we can handle temporarily offline PS when we first connect (#8094) MMeent 2024-06-19 15:05:31 +02:00
  • 56da624870 allow storage_controller error during pagebench (#8109) Peter Bendel 2024-06-19 15:04:29 +02:00
  • b998b70315 proxy: reduce some per-task memory usage (#8095) Conrad Ludgate 2024-06-19 13:34:15 +01:00
  • 76aa6936e8 tests: make Endpoint.stop() thread safe (occasional flakes in test_multi_attach) (#8110) John Spray 2024-06-19 13:14:50 +01:00
  • 438fd2aaf3 neon_local: background_process: launch all processes in repo dir (or datadir) (#8058) Christian Schwarz 2024-06-19 13:59:36 +02:00
  • e7d62a257d test: fix tenant duplication utility generation numbers (#8096) Vlad Lazar 2024-06-19 11:55:59 +01:00
  • 5778d714f0 storcon: add drain and fill background operations for graceful cluster restarts (#8014) Vlad Lazar 2024-06-19 11:55:30 +01:00
  • 45d7669089 test_pg_regress: increase timeout and always run vectored get validation Christian Schwarz 2024-06-19 12:30:35 +02:00
  • 1f9a39fb2e test_local_file_cache_unlink: make runtime independent of getpage latency Christian Schwarz 2024-06-19 12:19:21 +02:00
  • 8602096fc4 test_physical_replication: make runtime independent of getpage latency Christian Schwarz 2024-06-19 12:04:54 +02:00
  • 4753b8f390 Copy release images to prod ECR (#8101) Sergey Melnikov 2024-06-19 11:33:21 +02:00
  • fe7254b3fd update dashmap with new unsafe raw shards api update-dashmap Conrad Ludgate 2024-06-19 09:03:59 +01:00
  • c073be6f8d fix tests, remove traces from docs, remove imprecise cache lookup code Christian Schwarz 2024-06-19 00:26:02 +02:00
  • ed45edc11b cargo fmt Christian Schwarz 2024-06-18 21:33:37 +00:00
  • 68476bb4ba feat(pageserver): add iterator API for btree reader (#8083) Alex Chi Z 2024-06-18 16:02:57 -04:00
  • 6bb8b1d7c2 Remove dead code from walproposer_pg.c Arseny Sher 2024-06-18 16:13:47 +03:00
  • 30b890e378 feat(pageserver): use leases to temporarily block gc (#8084) Yuchen Liang 2024-06-18 13:37:06 -04:00
  • 560627b525 Replace a few references to Zenith with neon Heikki Linnakangas 2024-06-18 13:38:15 +03:00
  • 1c1b4b0c04 Add a bunch of items for new changes that we've made Heikki Linnakangas 2024-06-18 13:31:03 +03:00
  • b774ab54d4 Remove obsolete ones Heikki Linnakangas 2024-06-18 13:31:01 +03:00
  • 33a09946fc Prefetching has been implemented Heikki Linnakangas 2024-06-18 13:30:58 +03:00
  • 0396ed67f7 Update comments on various items Heikki Linnakangas 2024-06-18 13:30:56 +03:00
  • 8ee6724167 Update overview section to reflect current code organization Heikki Linnakangas 2024-06-18 13:30:53 +03:00
  • 6b67135bd3 Fix offset stream issue Arpad Müller 2024-06-18 01:08:33 +02:00
  • 66d3bef947 More printing and assertions Arpad Müller 2024-06-18 01:04:52 +02:00
  • e749e73ad6 Add the compression algo name Arpad Müller 2024-06-17 22:25:07 +02:00
  • c5034f0e45 Fix build Arpad Müller 2024-06-17 21:58:12 +02:00
  • d2533c06a5 Always delete the file, even on error Arpad Müller 2024-06-15 02:28:32 +02:00
  • 0fdeca882c Fix tests Arpad Müller 2024-06-15 00:24:25 +02:00
  • f1bebda713 Fix failing test Arpad Müller 2024-06-14 23:57:33 +02:00
  • 983972f812 Add tests for compression Arpad Müller 2024-06-14 18:03:50 +02:00
  • 2ea8d1b151 Shutdown instead of flush Arpad Müller 2024-06-14 13:58:45 +02:00
  • 2f70221503 Don't forget the flush Arpad Müller 2024-06-14 05:26:51 +02:00
  • 07bd0ce69e Also measure decompression time Arpad Müller 2024-06-14 05:18:38 +02:00
  • 40e79712eb Add decompression Arpad Müller 2024-06-12 16:04:39 +02:00
  • 88b24e1593 Move constants out into file Arpad Müller 2024-06-10 17:30:56 +02:00
  • 8fcdc22283 Add stats info Arpad Müller 2024-06-07 23:13:53 +02:00
  • 2eb8b428cc Also support the generation-less legacy naming scheme Arpad Müller 2024-06-07 22:12:04 +02:00
  • e6a0e7ec61 Add zstd with low compression quality Arpad Müller 2024-06-07 17:35:41 +02:00
  • 843d996cb1 More precise printing Arpad Müller 2024-06-07 16:41:06 +02:00
  • c824ffe1dc Add ZstdHigh compression mode Arpad Müller 2024-06-07 16:32:56 +02:00
  • dadbd87ac1 Add percent to output Arpad Müller 2024-06-07 01:57:45 +02:00
  • 0e667dcd93 more yielding Arpad Müller 2024-06-07 01:14:00 +02:00
  • 14447b98ce Yield in between Arpad Müller 2024-06-07 01:03:57 +02:00
  • 8fcb236783 Increase listing limit Arpad Müller 2024-06-07 00:26:02 +02:00
  • a9963db8c3 Create timeline dir in temp location if not existent Arpad Müller 2024-06-07 00:21:39 +02:00
  • 0c500450fe Print error better Arpad Müller 2024-06-06 23:49:44 +02:00
  • 3182c3361a Corrections Arpad Müller 2024-06-06 23:42:37 +02:00
  • 80803ff098 Printing tweaks Arpad Müller 2024-06-06 23:40:46 +02:00
  • 9b74d554b4 Remove generation suffix Arpad Müller 2024-06-06 23:35:58 +02:00
  • fce252fb2c Rename dest_path to tmp_dir Arpad Müller 2024-06-06 23:29:49 +02:00
  • f132658bd9 Some prints Arpad Müller 2024-06-06 23:28:09 +02:00
  • d030cbffec Print number of keys Arpad Müller 2024-06-06 23:24:54 +02:00
  • 554a6bd4a6 Two separate commands Arpad Müller 2024-06-06 23:11:02 +02:00
  • 9850794250 Remote layer file after done Arpad Müller 2024-06-06 23:06:05 +02:00
  • f5baac2579 clippy Arpad Müller 2024-06-04 16:27:14 +02:00
  • 2d37db234a Add mode to compare multiple files from a tenant Arpad Müller 2024-06-04 15:53:15 +02:00
  • 8745c0d6f2 Add a pagectl tool to recompress image layers Arpad Müller 2024-05-24 03:00:06 +02:00
  • 8a9fa0a4e4 build(deps): bump urllib3 from 1.26.18 to 1.26.19 (#8086) dependabot[bot] 2024-06-18 16:40:46 +01:00
  • cf60e4c0c5 build(deps): bump ws from 8.16.0 to 8.17.1 in /test_runner/pg_clients/typescript/serverless-driver (#8087) dependabot[bot] 2024-06-18 16:40:27 +01:00
  • 68a2298973 Add support to specifying storage account in AzureConfig (#8090) Arpad Müller 2024-06-18 16:03:23 +02:00
  • 73a525de62 walproposer: move CHECK_FOR_INTERRUPTS to after waiting. wp-mref Arseny Sher 2024-06-18 16:29:54 +03:00
  • 62c0c1d797 Allow to change compute safekeeper list without restart. Arseny Sher 2024-06-17 16:23:07 +03:00
  • 0dfef8d09c remove materialized page cache Christian Schwarz 2024-06-18 12:54:43 +00:00
  • 4feb6ba29c Make pull_timeline work with auth enabled. Arseny Sher 2024-06-13 22:47:58 +03:00
  • 29a41fc7b9 Implement holding off WAL removal for pull_timeline. Arseny Sher 2024-06-13 16:10:05 +03:00