Joonas Koivunen
f82ba477a4
http: limit genericremotestorage exposure
2023-08-28 12:43:11 +03:00
Joonas Koivunen
761644af25
dube: adjust comments
2023-08-28 12:43:11 +03:00
Joonas Koivunen
cd12d97ba7
dube: limit GenericRemoteStorage need
2023-08-28 12:43:11 +03:00
Joonas Koivunen
1e4ded860c
refactor: move LayerE::get
2023-08-28 12:43:11 +03:00
Joonas Koivunen
a0f29853b3
layere: rewrite to heavier_once_cell
2023-08-28 12:43:11 +03:00
Joonas Koivunen
c4cdf747f8
add heavier_once_cell
2023-08-28 12:43:11 +03:00
Joonas Koivunen
e658f16810
test_download_remote_layers_api: fix expected string
2023-08-28 12:43:11 +03:00
Joonas Koivunen
a4b4305422
cleanup while hunting for test_gc_cutoff problem
2023-08-28 12:43:11 +03:00
Joonas Koivunen
d8807eb651
test: fix test_broken_timeline (string matching)
2023-08-28 12:43:11 +03:00
Joonas Koivunen
1500f711f3
test: this test no longer makes sense, we dont replace
2023-08-28 12:43:11 +03:00
Joonas Koivunen
dafa42eb71
test: fix test assuming race between compaction and upload
2023-08-28 12:43:11 +03:00
Joonas Koivunen
b5e5ead2ee
delta_layer: allow unused load_keys
2023-08-28 12:43:09 +03:00
Joonas Koivunen
24251b8d17
botched rebase: added block_on code
2023-08-28 12:42:28 +03:00
Joonas Koivunen
e6378197a7
timeline: drop 2 indentation from get_reconstruct_value
2023-08-28 12:42:28 +03:00
Joonas Koivunen
4bb0cc2fe4
gc: reflect LayerE now managing remote client
2023-08-28 12:42:28 +03:00
Joonas Koivunen
9304f42ea5
tenant: remove unused imports
2023-08-28 12:42:28 +03:00
Joonas Koivunen
18f4eb2622
timeline: remove compare_arced_layers
2023-08-28 12:42:28 +03:00
Joonas Koivunen
2caa8bcc23
layer_manager: more clippy
2023-08-28 12:42:28 +03:00
Joonas Koivunen
bb222abde1
layer_manager: remove metrics, dependend by gc/compaction
2023-08-28 12:42:28 +03:00
Joonas Koivunen
dd2b4ad26f
layer_manager: cleanup unused
2023-08-28 12:42:28 +03:00
Joonas Koivunen
b65cb8ea05
storage_layer: we no longer clone for residency change
2023-08-28 12:42:28 +03:00
Joonas Koivunen
3a7efc10a0
timeline: cleanup unused imports
2023-08-28 12:42:28 +03:00
Joonas Koivunen
a682de1dba
Timeline: get_value_reconstruct_data: avoid warnings
2023-08-28 12:42:28 +03:00
Joonas Koivunen
45a542c335
tenant: pub(crate)
2023-08-28 12:42:28 +03:00
Joonas Koivunen
bdb98b288e
==== reprocessed
2023-08-28 12:42:28 +03:00
Joonas Koivunen
a06c8e9add
inmemory_layer: drop impl Layer
2023-08-28 12:42:28 +03:00
Joonas Koivunen
18eefd61eb
inmemory_layer: less warnings
2023-08-28 12:42:28 +03:00
Joonas Koivunen
a2de0574b5
inmemorylayer: flush integration, partial?
2023-08-28 12:42:28 +03:00
Joonas Koivunen
aa8e954197
layer_manager, layer_access_stats: remove witness sidequest
...
it was interfering with me moving responsibilities back and forth
2023-08-28 12:42:28 +03:00
Joonas Koivunen
30847e59b9
remove remote_layer instead of keep fixing
2023-08-28 12:42:28 +03:00
Joonas Koivunen
d930a581f8
layer_manager: compaction changes
2023-08-28 12:42:28 +03:00
Joonas Koivunen
931c22545b
compaction: clippies
2023-08-28 12:42:28 +03:00
Joonas Koivunen
366f3c8ff8
compaction: reflect LayerE now managing remote client
2023-08-28 12:42:28 +03:00
Joonas Koivunen
26c39d7b4c
timeline: pub(crate) compaction
2023-08-28 12:42:28 +03:00
Joonas Koivunen
6ffa5138ce
compaction: upload index on success
...
otherwise test_gc_of_remote_layers fails
2023-08-28 12:42:28 +03:00
Joonas Koivunen
975e1558cc
compaction: integration
2023-08-28 12:42:28 +03:00
Joonas Koivunen
82a955ebfe
layer_manager: resident layer flush l0 changes
2023-08-28 12:42:28 +03:00
Joonas Koivunen
82596f8807
delta_layer: reflect non-async LayerE::for_written
2023-08-28 12:42:28 +03:00
Joonas Koivunen
e3e57579a1
integrate: download_all_layers
...
this time around with graceful cancellation.
2023-08-28 12:42:28 +03:00
Joonas Koivunen
56d551e6a3
==== reprocessed
2023-08-28 12:42:28 +03:00
Joonas Koivunen
b4a0f8baf7
integrate: Timeline::get_value_reconstruct_data
2023-08-28 12:42:28 +03:00
Joonas Koivunen
2e686ed6ea
eviction: integration
...
- evictiontask: remove unused imports
- eviction_task and dube: cleanup
- timeline: pub(crate) eviction
- timeline: adjust to "layere: adjust eviction"
- test: remove layer_eviction_aba_fails because it can no longer happen
- test: fix up evicts later test with ability to await for eviction
- eviction_task: more unused imports
- eviction: clippy
- eviction_task: more clippy
- fixup eviction: docs
- eviction: hold only Arc<Layer> after checking downloadedness
- refactor earlier eviction: use drop_eviction_guard instead
- dube: evict in spawned tasks
- timeline, eviction: evict in spawned
- eviction: add more errors
- evict_layers: remove witness
- eviction: post-witness forgotten panic
- eviction: remove blog references
2023-08-28 12:42:28 +03:00
Joonas Koivunen
c46f72d411
create_image_layers integration (multifile)
2023-08-28 12:42:28 +03:00
Joonas Koivunen
ed46713e5c
remote_timeline_client: pub(crate) on upload
2023-08-28 12:42:28 +03:00
Joonas Koivunen
c228cb7b3f
remote_timeline_client: continued integration work post ResidentLayer
2023-08-28 12:42:28 +03:00
Joonas Koivunen
c88e4a0974
layer_manager: integration
2023-08-28 12:42:28 +03:00
Joonas Koivunen
b71a2f4cb2
load_layer_map: integration
2023-08-28 12:42:23 +03:00
Joonas Koivunen
98a7b090de
========= layere
2023-08-28 12:41:31 +03:00
Joonas Koivunen
235a8cbd28
wip: LayerE
2023-08-28 12:41:31 +03:00
Joonas Koivunen
6afeb3c6f7
========= unrelated
2023-08-28 12:41:31 +03:00