Commit Graph

  • 43bb10a58d sq move open layer Vlad Lazar 2024-04-09 13:37:53 +01:00
  • ccdf185b8e pageserver: arc swap in memory layer Vlad Lazar 2024-04-09 13:37:17 +01:00
  • b27368bfec pageserver: move open layer into timeline ... Vlad Lazar 2024-04-09 13:10:32 +01:00
  • c9e8ae40dd Revert "benchmark numbers" Christian Schwarz 2024-04-09 11:35:47 +00:00
  • 0047481cc8 Revert "Revert "Revert "HACK: restore old impl, make runtime configurable (how to: reconfigure via HTTP, then kill existing walredo procs)""" Christian Schwarz 2024-04-09 11:35:07 +00:00
  • feaca7bc1e Revert "fixup: re-apply bring-back of wal_redo_timeout changes after file movements" Christian Schwarz 2024-04-09 11:32:56 +00:00
  • 5d12475664 Revert "Revert "Revert "make the default process kind runtime-configurable, and switch to sync""" Christian Schwarz 2024-04-09 11:32:47 +00:00
  • 4f4f787119 Update staging hostname (#7347) Alexander Bayandin 2024-04-09 12:03:46 +01:00
  • 6e0a02de27 benchmark numbers Christian Schwarz 2024-04-09 10:58:13 +00:00
  • afd2c1369e adjust bench for both sync and async benchmarking Christian Schwarz 2024-04-09 10:46:10 +00:00
  • b44bbd276e HACK: set walredo process kind metric on startup Christian Schwarz 2024-04-09 07:59:04 +00:00
  • bcab344490 CI(flaky-tests): remove outdated restriction (#7345) Alexander Bayandin 2024-04-09 10:50:43 +01:00
  • f212630da2 update measured with some more convenient features (#7334) Conrad Ludgate 2024-04-08 19:01:41 +01:00
  • aad5a672f0 DO NOT MERGE: diable materialized page cache for benchmarking Christian Schwarz 2024-03-22 21:27:52 +00:00
  • 5565087dba Merge remote-tracking branch 'origin/problame/async-walredo/benchmarking-2024-04-08--1' into problame/async-walredo/benchmarking-2024-04-08--1 Christian Schwarz 2024-04-08 15:40:34 +00:00
  • 825c0e30e8 Revert "Revert "make the default process kind runtime-configurable, and switch to sync"" Christian Schwarz 2024-04-08 15:36:34 +00:00
  • f489a10509 fixup: re-apply bring-back of wal_redo_timeout changes after file movements Christian Schwarz 2024-04-08 15:26:12 +00:00
  • bea2e121dd Revert "Revert "HACK: restore old impl, make runtime configurable (how to: reconfigure via HTTP, then kill existing walredo procs)"" Christian Schwarz 2024-04-08 15:14:40 +00:00
  • 6f714c308b Adjust timeouts Arpad Müller 2024-04-08 17:02:40 +02:00
  • 2e6afaa642 Merge remote-tracking branch 'origin/main' into arpad/less_async_trait Arpad Müller 2024-04-08 16:58:47 +02:00
  • 82e7e4d84a DO NOT MERGE: benchmarking setup Christian Schwarz 2024-03-22 09:53:02 +00:00
  • 4a84446b78 wip Vlad Lazar 2024-04-08 15:58:32 +01:00
  • 4ef2fb29fa bring back wal_redo_timeout Christian Schwarz 2024-04-08 14:53:52 +00:00
  • a306d0a54b implement Serialize/Deserialize for SystemTime with RFC3339 format (#7203) Kevin Mingtarja 2024-04-08 22:53:07 +08:00
  • c85fd74d34 Fix test_physical_replication test taken in acount autocommit behaviour of psycopg Konstantin Knizhnik 2024-04-08 17:37:48 +03:00
  • ffef90f3db Merge remote-tracking branch 'origin/main' into problame/integrate-tokio-epoll-uring/benchmarking/2024-01-31-prs/async-walredo Christian Schwarz 2024-04-08 14:31:48 +00:00
  • 1081a4d246 pageserver: option to run with just one tokio runtime (#7331) Christian Schwarz 2024-04-08 16:27:08 +02:00
  • d8a926618e tokio-test not necessary Christian Schwarz 2024-04-08 14:26:22 +00:00
  • c38b3e6ad6 Revert "HACK: restore old impl, make runtime configurable (how to: reconfigure via HTTP, then kill existing walredo procs)" Christian Schwarz 2024-04-08 14:14:07 +00:00
  • b72891d28c Revert "make the default process kind runtime-configurable, and switch to sync" Christian Schwarz 2024-04-08 14:08:36 +00:00
  • 5efaddea02 Merge remote-tracking branch 'origin/problame/configurable-one-runtime' into problame/integrate-tokio-epoll-uring/benchmarking/2024-01-31-prs/async-walredo Christian Schwarz 2024-04-08 14:03:18 +00:00
  • 47b705cffe Remove async_trait from CompactionDeltaLayer (#7342) Arpad Müller 2024-04-08 14:59:08 +02:00
  • aa5439cb6e Merge remote-tracking branch 'origin/main' into problame/configurable-one-runtime Christian Schwarz 2024-04-08 12:24:43 +00:00
  • 5da39b469c Merge pull request #7338 from neondatabase/rc/2024-04-08 release-5267 Vlad Lazar 2024-04-08 13:10:24 +01:00
  • 8f0a0440ba CI: reduce session timeout to 30 minutes Alexander Bayandin 2024-04-08 12:29:24 +01:00
  • 2d3c9f0d43 refactor(pageserver): use tokio::signal instead of spawn_blocking (#7332) Christian Schwarz 2024-04-08 11:35:32 +02:00
  • 21b3e1d13b fix(utilization): return used as does df (#7337) Joonas Koivunen 2024-04-08 09:01:38 +03:00
  • 0788760451 tests: further stabilize test_deletion_queue_recovery (#7335) John Spray 2024-04-07 22:21:18 +01:00
  • 74b2314a5d control_plane: revise compute_hook locking (don't serialise all calls) (#7088) John Spray 2024-04-06 20:51:59 +01:00
  • edcaae6290 fixup: PR #7319 defined workload.py def stop() twice (#7333) Christian Schwarz 2024-04-05 21:11:04 +02:00
  • dc8e318a42 fix copy-pasta Christian Schwarz 2024-04-05 17:58:21 +00:00
  • 871a3caca9 change thread name Christian Schwarz 2024-04-05 17:57:41 +00:00
  • edd7f69c2d make current_thread mode work Christian Schwarz 2024-04-05 17:51:04 +00:00
  • 70fb7e3580 metric, useful for rollout / analyzing grafana metrics Christian Schwarz 2024-04-05 17:34:04 +00:00
  • 4fc95d2d71 pageserver: apply shard filtering to blocks ingested during initdb (#7319) John Spray 2024-04-05 18:07:35 +01:00
  • 534c099b42 tests: improve stability of test_deletion_queue_recovery (#7325) John Spray 2024-04-05 18:01:31 +01:00
  • 6b820bb423 fixup env var value parsing Christian Schwarz 2024-04-05 16:42:35 +00:00
  • ec01292b55 storage controller: rename TenantState to TenantShard (#7329) John Spray 2024-04-05 17:29:53 +01:00
  • 393f323106 collect lfc stats from vm-monitor skyzh/lfc-stat Alex Chi Z 2024-04-03 17:11:45 -04:00
  • 740efb0ab5 cleanup Christian Schwarz 2024-04-05 17:21:49 +02:00
  • 5cf45df692 remove env_config::Bool Christian Schwarz 2024-04-05 17:17:35 +02:00
  • 3779854f12 rename "single runtime" to "one runtime", allow configuring current_thread and multi_thread:$num_workers Christian Schwarz 2024-04-05 17:16:18 +02:00
  • dc03f7a44f pageserver: ability to use a single runtime Christian Schwarz 2024-04-05 16:31:16 +02:00
  • 43cf9d10d2 env_config improvements Christian Schwarz 2024-04-05 16:29:53 +02:00
  • 31d4d1e233 env_config from PR #6125 Christian Schwarz 2024-04-05 10:49:31 +02:00
  • 66fc465484 Clean up 'attachment service' names to storage controller (#7326) John Spray 2024-04-05 16:18:00 +01:00
  • 55da8eff4f proxy: report metrics based on cold start info (#7324) Conrad Ludgate 2024-04-05 16:14:50 +01:00
  • 987dc01ed7 CI: set fix timeout value in seconds for regression tests Alexander Bayandin 2024-04-05 15:05:07 +01:00
  • 719e4ad580 Bump pytest-timeout from 2.1.0 to 2.3.1 Alexander Bayandin 2024-04-05 14:58:58 +01:00
  • 0fa517eb80 Update test-context dependency to 0.3 (#7303) Arpad Müller 2024-04-05 15:53:29 +02:00
  • e61b2a08b3 CI: set pytest timeout for regression test suite Alexander Bayandin 2024-04-05 12:54:47 +01:00
  • 8ceb4f0a69 Fix partial zero segment upload (#7318) Arthur Petukhovsky 2024-04-05 12:48:08 +02:00
  • 6019ccef06 tests: extend log allow list in test_storcon_cli (#7321) John Spray 2024-04-05 11:44:15 +01:00
  • 0c6367a732 storage controller: fix repeated location_conf returning no shards (#7314) John Spray 2024-04-04 18:34:05 +01:00
  • e17bc6afb4 pageserver: update mgmt_api to use TenantShardId (#7313) John Spray 2024-04-04 18:23:45 +01:00
  • ac7fc6110b pageserver: handle WAL gaps on sharded tenants (#6788) John Spray 2024-04-04 17:54:38 +01:00
  • 862a6b7018 pageserver: timeout on deletion queue flush in timeline deletion (#7315) John Spray 2024-04-04 17:51:44 +01:00
  • 4810c22607 fix(walredo spawn): coalescing stalls other executors std::sync::RwLock (#7310) Christian Schwarz 2024-04-04 17:54:14 +02:00
  • 0008ee81a8 sq Vlad Lazar 2024-04-04 16:40:39 +01:00
  • 5b30b9fe11 sq Vlad Lazar 2024-04-04 16:38:34 +01:00
  • 74745c4e7a sq Vlad Lazar 2024-04-04 16:37:37 +01:00
  • 5a5fa2158b pageserver: thread tenant conf to in mem layer Vlad Lazar 2024-04-04 16:36:37 +01:00
  • cc89b46ae5 Merge branch 'main' into arpad/less_async_trait Arpad Müller 2024-04-04 16:30:09 +02:00
  • 9d754e984f storage_controller: setup sentry reporting (#7311) Vlad Lazar 2024-04-04 13:41:04 +01:00
  • 375e15815c storage controller: grant 'admin' access to all APIs (#7307) John Spray 2024-04-04 12:22:08 +01:00
  • 55e0fd9789 Merge pull request #7304 from neondatabase/rc/proxy/2024-04-04 release-proxy-5238 Anna Khanova 2024-04-04 12:40:11 +02:00
  • d5cbdd2e90 Remove it here as well Arpad Müller 2024-04-04 12:36:28 +02:00
  • 7ce613354e Fix length (#7308) Anna Khanova 2024-04-04 12:29:10 +02:00
  • ae15acdee7 Fix bug in prefetch cleanup (#7277) Konstantin Knizhnik 2024-04-04 13:28:22 +03:00
  • 6ad9c3560e Merge branch 'main' into arpad/less_async_trait Arpad Müller 2024-04-04 12:27:38 +02:00
  • a12072b789 tests: add test_sharding_compaction jcsp/storcon-tests John Spray 2024-02-15 14:07:57 +00:00
  • c5f64fe54f tests: reinstate some syntethic size tests (#7294) Vlad Lazar 2024-04-04 10:45:14 +01:00
  • 40852b955d update ordered-multimap (#7306) Conrad Ludgate 2024-04-04 09:55:43 +01:00
  • 9dc3b09e57 Remove async-trait from Cargo.toml of crates it became unused in Arpad Müller 2024-04-03 23:24:01 +02:00
  • fe762e35d8 Remove async_trait from Handler trait as well Arpad Müller 2024-04-03 23:19:03 +02:00
  • 0c4988a92c Remove async_trait from CompactionDeltaLayer Arpad Müller 2024-04-03 22:56:45 +02:00
  • c77ce7cdc3 Merge remote-tracking branch 'origin/main' into problame/integrate-tokio-epoll-uring/benchmarking/2024-01-31-prs/async-walredo Christian Schwarz 2024-04-03 21:11:03 +02:00
  • 67a7abc7cf make the default process kind runtime-configurable, and switch to sync Christian Schwarz 2024-04-03 21:00:06 +02:00
  • cca66e5e82 HACK: restore old impl, make runtime configurable (how to: reconfigure via HTTP, then kill existing walredo procs) Christian Schwarz 2024-03-22 10:23:53 +00:00
  • 57e6b00c4d out of curiosity, use threaded tracing_chrome problame/investigate-why-timeline-create-so-slow Christian Schwarz 2024-04-03 17:27:20 +00:00
  • 8bc8d9d918 utils::logging: implement tracing_chrome & tracing_flame support Christian Schwarz 2023-12-06 17:48:50 +00:00
  • bbe9c52357 disable initdb archive creation to discern its impact on spawn_blocking pool (perhaps we can just make it one big sync task) Christian Schwarz 2024-04-03 16:14:59 +00:00
  • 0be19f4a6d bootstrap_timeline: use tokio::fs for walingestion & use BufRead/BufWrite Christian Schwarz 2024-04-03 16:12:26 +00:00
  • b30b15e7cb refactor(Timeline::shutdown): rely more on Timeline::cancel; use it from deletion code path (#7233) Christian Schwarz 2024-04-03 17:49:54 +02:00
  • 36b875388f pageserver: replace the locked tenant config with arcsawps (#7292) Vlad Lazar 2024-04-03 16:46:25 +01:00
  • 3f77f26aa2 Upload partial segments (#6530) Arthur Petukhovsky 2024-04-03 17:20:51 +02:00
  • 8b10407be4 pageserver: on-demand activation of tenant on GET tenant status (#7250) John Spray 2024-04-03 14:53:43 +01:00
  • 944313ffe1 Schedule image layer uploads in tiered compaction (#7282) Arpad Müller 2024-04-03 13:42:45 +02:00
  • d443d07518 wal_ingest: global counter for bytes received (#7240) Joonas Koivunen 2024-04-03 13:30:14 +03:00
  • 3de416a016 refactor(walreceiver): eliminate task_mgr usage (#7260) Christian Schwarz 2024-04-03 12:28:04 +02:00