Commit Graph

  • ac611a6c61 Merge branch 'main' into jcsp/az-fill jcsp/az-fill John Spray 2024-11-29 18:24:02 +00:00
  • 60818dfdc9 use the same context Christian Schwarz 2024-11-29 19:18:48 +01:00
  • 61d0c8ea2c compiles and uses ctx, but attached_child, not request context Christian Schwarz 2024-11-29 19:16:59 +01:00
  • 724519a21b got the lifetimes to work Christian Schwarz 2024-11-29 19:13:59 +01:00
  • 3993979a98 try add RequestContext throttle time tracking back Christian Schwarz 2024-11-29 19:01:57 +01:00
  • c848f25ec2 Fixed fast_import pgbin in calling get_pg_version (#9933) Gleb Novikov 2024-11-29 17:58:36 +00:00
  • 92b36197f8 abbreviated benchmark run on hetzner box Christian Schwarz 2024-11-29 18:58:25 +01:00
  • 7a39ad4832 correct start & end times for smgr query observations (fixes #9925) at the expense of exclusion of throttling from metrics (too complicated lifetimes) Christian Schwarz 2024-11-29 18:49:41 +01:00
  • 6d36c07a33 Merge remote-tracking branch 'origin/problame/batching-sidecar-task' into problame/batching-metrics-improvements Christian Schwarz 2024-11-29 17:58:49 +01:00
  • d064cf4065 storcon: AZ awareness when filling nodes John Spray 2024-11-29 16:57:01 +00:00
  • 1cf5b1463f benchmark results on hetzner box Christian Schwarz 2024-11-29 17:42:50 +01:00
  • 2cab051921 fix escaping of lfc path (exposed by the benchmark) Christian Schwarz 2024-11-29 17:25:54 +01:00
  • 9b65b268ed stop Box'ing stuff & clean up the passing-through of errors (remove enum Batch) Christian Schwarz 2024-11-29 16:14:03 +01:00
  • 53e18b24fc less repetitive match arms; https://github.com/neondatabase/neon/pull/9851#discussion_r1860535860 Christian Schwarz 2024-11-29 16:10:27 +01:00
  • d5624cc505 pageserver: download small objects using a smaller timeout (#9938) John Spray 2024-11-29 15:11:44 +00:00
  • 7a580627fc fixup! AccSwitchConf, AbortChange, AccReset Arseny Sher 2024-11-29 17:38:11 +03:00
  • 176fe2cade remove identic switch Arseny Sher 2024-11-29 17:34:38 +03:00
  • c846389812 AccSwitchConf, AbortChange, AccReset Arseny Sher 2024-11-29 17:25:17 +03:00
  • 0d28084985 merge brought back test_pageserver_getpage_merge.py Christian Schwarz 2024-11-29 15:23:47 +01:00
  • 538e2312a6 feat(compute_ctl): Always set application_name (#9934) Alexey Kondratov 2024-11-29 14:55:56 +01:00
  • a6073b5013 safekeeper: use jemalloc (#9780) Erik Grinaker 2024-11-29 15:38:04 +02:00
  • cb1ebedc9f FinishChange Arseny Sher 2024-11-29 16:32:08 +03:00
  • ea3798e3b3 storage controller: use proper ScheduleContext when evacuating a node (#9908) John Spray 2024-11-29 13:27:49 +00:00
  • 199a4bd6c1 Merge remote-tracking branch 'origin/main' into problame/batching-sidecar-task Christian Schwarz 2024-11-29 14:26:37 +01:00
  • bab3dd009d Merge remote-tracking branch 'origin/main' into problame/batching-sidecar-task Christian Schwarz 2024-11-29 14:19:06 +01:00
  • 90ef03c3b5 benchmarks on hetzner box Christian Schwarz 2024-11-29 13:50:28 +01:00
  • dfcbb139fb the None configuration in the benchmark would use the default instead of the serial configuration; fix that Christian Schwarz 2024-11-29 13:35:24 +01:00
  • 08b19dd6aa reconfig CommitEntries Arseny Sher 2024-11-29 14:14:34 +03:00
  • 27c72e4ff3 benchmark on hetzner box Christian Schwarz 2024-11-29 12:08:05 +01:00
  • 1d642d6a57 chore(proxy): vendor a subset of rust-postgres (#9930) Conrad Ludgate 2024-11-29 11:08:01 +00:00
  • 9a5611a5ef merge reader&batcher stages, update docs Christian Schwarz 2024-11-29 11:39:16 +01:00
  • 3ffe6de0b9 test_runner/performance: add logical message ingest benchmark (#9749) Erik Grinaker 2024-11-29 10:40:08 +01:00
  • 1ca9b56faf Merge pull request #9935 from neondatabase/compute-rc-2024-11-28 release-7245 Heikki Linnakangas 2024-11-29 09:58:00 +02:00
  • ced1903267 Rework CommitEntries Arseny Sher 2024-11-29 10:11:33 +03:00
  • f44bfcc7f4 benchmark on hetzner runner Christian Schwarz 2024-11-28 22:40:53 +01:00
  • 42fb3c4d30 fix(compute_ctl): Allow usage of DB names with whitespaces (#9919) Alexey Kondratov 2024-11-28 22:38:30 +01:00
  • a2a3613185 reintroduce task-based execution Christian Schwarz 2024-11-28 20:50:06 +01:00
  • 6bd39f95f5 rn benchmark on hetzner runner Christian Schwarz 2024-11-28 20:24:01 +01:00
  • 07358dea89 converge on approach that pushes read Result through pipeline Christian Schwarz 2024-11-28 20:06:15 +01:00
  • e04dd3be0b test_runner: rerun all failed tests (#9917) Alexander Bayandin 2024-11-28 19:02:57 +00:00
  • eb520a14ce pageserver: return correct LSN for interpreted proto keep alive responses (#9928) Vlad Lazar 2024-11-28 17:38:47 +00:00
  • e3e3b721ec fix pgversion; override virtual_file_io_mode yuchen/bench-double-buffered-writer Yuchen Liang 2024-11-28 15:51:48 +00:00
  • 1ca71d607b wip Erik Grinaker 2024-11-19 23:23:55 +01:00
  • eb5d832e6f Update rust to 1.83.0, also update cargo adjacent tools (#9926) Arpad Müller 2024-11-28 16:49:30 +01:00
  • 70780e310c Makefile: build pg_visibility (#9922) Erik Grinaker 2024-11-28 16:48:18 +01:00
  • 0e0d8276da Pass start_timeout to the neon_fixtrures.py::NeonEnvBuilder::start() method and set it to 30s Fedor Dikarev 2024-11-28 14:45:16 +01:00
  • e82f7f0dfc remote_storage/abs: count 404 and 304 for get as ok for metrics (#9912) Vlad Lazar 2024-11-28 10:11:08 +00:00
  • 8a6ee79f6f Merge pull request #9921 from neondatabase/rc/release-proxy/2024-11-28 release-proxy-6953 Folke Behrens 2024-11-28 11:09:06 +01:00
  • 8173dc600a proxy: spawn cancellation checks in the background (#9918) Ivan Efremov 2024-11-28 08:32:22 +02:00
  • 9052c32b46 Proxy release 2024-11-28 github-actions[bot] 2024-11-28 06:02:15 +00:00
  • da1daa2426 pageserver: only apply ClearVmBits on relevant shards (#9895) Erik Grinaker 2024-11-27 20:44:24 +01:00
  • 9e3cb75bc7 fix(pageserver): flush deletion queue in reload shutdown mode (#9884) Alex Chi Z. 2024-11-27 13:30:54 -05:00
  • 5c41707bee proxy: promote two logs to error, fix multiline log (#9913) Folke Behrens 2024-11-27 19:05:46 +01:00
  • cc37fa0f33 pageserver: add metrics for unknown ClearVmBits pages (#9911) Erik Grinaker 2024-11-27 18:16:41 +01:00
  • 23f5a27146 fix(storage-scrubber): valid layermap error degrades to warning (#9902) Alex Chi Z. 2024-11-27 11:07:39 -05:00
  • b6a2516c1c Merge branch 'main' into yuchen/double-buffered-writer Yuchen Liang 2024-11-27 10:10:53 -05:00
  • b54764bccb hold timeline open in background task using gate guard (#9825) Yuchen Liang 2024-11-27 10:10:38 -05:00
  • 9584317564 writing entries, remove prop null conf Arseny Sher 2024-11-27 16:55:38 +03:00
  • e4f437a354 pageserver: add relsize cache metrics (#9890) Erik Grinaker 2024-11-27 14:54:14 +01:00
  • 8fdf786217 pageserver: add tenant config override for wal receiver proto (#9888) Vlad Lazar 2024-11-27 13:46:23 +00:00
  • 6666f6807b wal_decoder: reuse codec throughout sender/receiver lifetime vlad/sk-ps-codec Vlad Lazar 2024-11-26 16:50:17 +01:00
  • 9e0148de11 safekeeper: use protobuf for sending compressed records to pageserver (#9821) Vlad Lazar 2024-11-27 12:12:21 +00:00
  • 82e1fa3f83 WIP Christian Schwarz 2024-11-27 12:31:56 +01:00
  • 4c7bdfa70a becomeleader Arseny Sher 2024-11-27 14:19:43 +03:00
  • 7b41ee872e CI(pre-merge-checks): build only one build-tools-image (#9718) Alexander Bayandin 2024-11-27 10:42:26 +00:00
  • 277c33ba3f ingest benchmark: after effective_io_concurrency = 100 we can increase compute side parallelism (#9904) Peter Bendel 2024-11-27 11:09:01 +01:00
  • 59cb648457 voting Arseny Sher 2024-11-27 12:53:26 +03:00
  • 7fb3d95596 review & identified a cast that isn't handled, document that Christian Schwarz 2024-11-27 10:33:53 +01:00
  • e0123c8a80 explain the pipeline cancellation story Christian Schwarz 2024-11-27 10:13:51 +01:00
  • 18ffaba975 fix pipeline cancellation Christian Schwarz 2024-11-26 20:25:10 +01:00
  • 2b788cb53f Bump neon.logical_replication_max_snap_files default to 10000 (#9896) Tristan Partin 2024-11-26 11:49:37 -06:00
  • 4fe36706d9 pageserver: only apply ClearVmBits on relevant shards erik/prod-with-profile Erik Grinaker 2024-11-26 17:18:54 +01:00
  • 8c880d088b RestartProposer Arseny Sher 2024-11-26 16:52:05 +03:00
  • c940f196ce Start reconfig Arseny Sher 2024-11-26 15:00:16 +03:00
  • d0b4b3e64a fmt Arseny Sher 2024-11-26 16:34:26 +03:00
  • 41ddc6772c benchmark Christian Schwarz 2024-11-26 13:56:46 +01:00
  • 673815a056 Log relation existence Erik Grinaker 2024-11-26 13:43:04 +01:00
  • a23abb2cc0 adopt spsc_fold Christian Schwarz 2024-11-26 13:30:40 +01:00
  • 9bf2618c45 implement spsc_fold Christian Schwarz 2024-11-26 12:30:23 +01:00
  • 13feda0669 track how much time the flush loop is stalled waiting for uploads (#9885) Peter Bendel 2024-11-26 12:46:58 +01:00
  • ee4cbe8778 Log when vm_size=0 Erik Grinaker 2024-11-26 12:11:04 +01:00
  • 204eaa194f pageserver: add relsize cache metrics Erik Grinaker 2024-11-26 10:37:14 +01:00
  • 96a1b71c84 chore(proxy): discard request context span during passthrough (#9882) Conrad Ludgate 2024-11-25 21:32:53 +00:00
  • a74ab9338d fast_import: remove hardcoding of pg_version (#9878) Arpad Müller 2024-11-25 21:23:42 +01:00
  • c3302ad7e1 Merge branch 'main' into yuchen/double-buffered-writer Yuchen Liang 2024-11-25 14:49:42 -05:00
  • 7404887b81 proxy: Demote errors from cplane request routines to debug (#9886) Folke Behrens 2024-11-25 20:35:32 +01:00
  • 87e4dd23a1 proxy: Demote all cplane error replies to info log level (#9880) Folke Behrens 2024-11-25 18:53:26 +01:00
  • 8379efda6a wip: set default proto to interpreted compressed protobuf vlad/sk-ps-protobuf-test Vlad Lazar 2024-11-20 16:36:16 +01:00
  • 884803a51f wip: use pack-interpreted branch of rust-postgres Vlad Lazar 2024-11-20 14:33:27 +01:00
  • 7ebbdad141 tests: fix currently protocol parametrised tests Vlad Lazar 2024-11-20 16:29:16 +01:00
  • 1db16e29dc tests: update sharded ingest test to use compression Vlad Lazar 2024-11-20 14:30:16 +01:00
  • cbe00424a6 safekeeper: pipeline WAL sending Vlad Lazar 2024-11-20 13:32:43 +01:00
  • 0a13a06053 wal_decoder: add compression support Vlad Lazar 2024-11-20 12:32:22 +01:00
  • 6009d9fe4d wal_decoder: add protobuf support Vlad Lazar 2024-11-19 19:41:21 +01:00
  • b32c6a8798 wal_decoder: generate protobuf types Vlad Lazar 2024-11-19 19:40:40 +01:00
  • 8ffb1c1e51 wal_decoder: define records batch type Vlad Lazar 2024-11-19 15:33:42 +01:00
  • 7b0f1605b2 wal_decoder: abstract wire format Vlad Lazar 2024-11-19 14:12:19 +01:00
  • 7a2f0ed8d4 safekeeper: lift decoding and interpretation of WAL to the safekeeper (#9746) Vlad Lazar 2024-11-25 17:29:28 +00:00
  • 5c2356988e page_service: add benchmark for batching (#9820) Christian Schwarz 2024-11-25 16:52:39 +01:00
  • 23e579d01f Merge pull request #9881 from neondatabase/rc/release/2024-11-25--2 release-7215 Christian Schwarz 2024-11-25 16:26:02 +01:00