Joonas Koivunen
39b85cc6fd
layere: record residency changes with download/evict
2023-08-28 12:49:56 +03:00
Joonas Koivunen
eccb868a50
doc: consider cancellation and redownload
2023-08-28 12:49:56 +03:00
Joonas Koivunen
de93c70f2f
provide and use LayerE::for_evicted
2023-08-28 12:49:56 +03:00
Joonas Koivunen
72430eb539
layere: remove impossible error case
2023-08-28 12:49:56 +03:00
Joonas Koivunen
e2443a0147
remove ability to have 'static DeltaEntry
2023-08-28 12:49:55 +03:00
Joonas Koivunen
e5d00b6c2a
fix: compaction can and should use borrowed DeltaEntrys
...
otherwise we risk evicting the L0 while we are reading different blobs
out of it.
2023-08-28 12:46:55 +03:00
Joonas Koivunen
dc97970215
chore(ref): make pub
2023-08-28 12:46:53 +03:00
Joonas Koivunen
bc5a643c19
fix: use new LayerE::for_resident
2023-08-28 12:43:11 +03:00
Joonas Koivunen
b1134f6857
layere: add new ctor
2023-08-28 12:43:11 +03:00
Joonas Koivunen
04ab9b78fe
test: add more allowed outcomes
...
I cannot see a quick fix to make one them winner, nor a reason why it
should be done; at worst case there could be double accounting for some
evicted layer should the two do it at the same time.
2023-08-28 12:43:11 +03:00
Joonas Koivunen
fa0b881c4c
remove previous generation of Layer, PersistentLayer
...
- remove get_value_reconstruct_data for Delta, Image
- remove unnecessary default trait method
- remove trait PersistentLayer
- remove unused {Delta,Image}Layer::new()
- continued dead code removal
- unify ImageLayer to be like DeltaLayer
- dead code and imports cleanup
- remove PathOrConfig
- correct few doc links re: Layer removal
2023-08-28 12:43:11 +03:00
Joonas Koivunen
106bda1ef9
layer_map: finally remove replacement related tests
2023-08-28 12:43:11 +03:00
Joonas Koivunen
c2de71e1fe
test: fix test_timeline_deletion_with_files_stuck_in_upload_queue, global allowed_error
2023-08-28 12:43:11 +03:00
Joonas Koivunen
3eba531c3d
test: fixup layere error type introduction, string change
2023-08-28 12:43:11 +03:00
Joonas Koivunen
088bea8680
test: add hint about mismatch cause
2023-08-28 12:43:11 +03:00
Joonas Koivunen
a9b0ac92bc
layere: decrement resident size if removed
...
make the problem of not knowing more explicit.
2023-08-28 12:43:11 +03:00
Joonas Koivunen
3045956ddd
refactor(LayerE): use new internal api
2023-08-28 12:43:11 +03:00
Joonas Koivunen
599069b612
eviction: remove comment
2023-08-28 12:43:11 +03:00
Joonas Koivunen
54873844c2
layere: introduce internal error type
2023-08-28 12:43:11 +03:00
Joonas Koivunen
dfdd41a771
layere: move task_name closer
2023-08-28 12:43:11 +03:00
Joonas Koivunen
12763ca312
layere: reset wanted_evicted only if downloading
2023-08-28 12:43:11 +03:00
Joonas Koivunen
4c80c8c1ab
test: fix changed string (no more remote layer remote)
...
this should be the only one:
https://neon-github-public-dev.s3.amazonaws.com/reports/pr-4938/5922954346/index.html#suites/7745dadbd815ab87f5798aa881796f47/96ce406b6d6a7427
2023-08-28 12:43:11 +03:00
Joonas Koivunen
acd2e7f222
timeline: fix test after wait_and_evict
2023-08-28 12:43:11 +03:00
Joonas Koivunen
a6b6dd2f36
timeline: reflect evict_and_wait in tests
2023-08-28 12:43:11 +03:00
Joonas Koivunen
0fd14ad74b
timeline: remove GenericRemoteStorage exposure
2023-08-28 12:43:11 +03:00
Joonas Koivunen
52eaa52573
wip: get rid of LayerE::evict
2023-08-28 12:43:11 +03:00
Joonas Koivunen
1e33692c1c
comment out the delta dumping test
2023-08-28 12:43:11 +03:00
Joonas Koivunen
f82ba477a4
http: limit genericremotestorage exposure
2023-08-28 12:43:11 +03:00
Joonas Koivunen
761644af25
dube: adjust comments
2023-08-28 12:43:11 +03:00
Joonas Koivunen
cd12d97ba7
dube: limit GenericRemoteStorage need
2023-08-28 12:43:11 +03:00
Joonas Koivunen
1e4ded860c
refactor: move LayerE::get
2023-08-28 12:43:11 +03:00
Joonas Koivunen
a0f29853b3
layere: rewrite to heavier_once_cell
2023-08-28 12:43:11 +03:00
Joonas Koivunen
c4cdf747f8
add heavier_once_cell
2023-08-28 12:43:11 +03:00
Joonas Koivunen
e658f16810
test_download_remote_layers_api: fix expected string
2023-08-28 12:43:11 +03:00
Joonas Koivunen
a4b4305422
cleanup while hunting for test_gc_cutoff problem
2023-08-28 12:43:11 +03:00
Joonas Koivunen
d8807eb651
test: fix test_broken_timeline (string matching)
2023-08-28 12:43:11 +03:00
Joonas Koivunen
1500f711f3
test: this test no longer makes sense, we dont replace
2023-08-28 12:43:11 +03:00
Joonas Koivunen
dafa42eb71
test: fix test assuming race between compaction and upload
2023-08-28 12:43:11 +03:00
Joonas Koivunen
b5e5ead2ee
delta_layer: allow unused load_keys
2023-08-28 12:43:09 +03:00
Joonas Koivunen
24251b8d17
botched rebase: added block_on code
2023-08-28 12:42:28 +03:00
Joonas Koivunen
e6378197a7
timeline: drop 2 indentation from get_reconstruct_value
2023-08-28 12:42:28 +03:00
Joonas Koivunen
4bb0cc2fe4
gc: reflect LayerE now managing remote client
2023-08-28 12:42:28 +03:00
Joonas Koivunen
9304f42ea5
tenant: remove unused imports
2023-08-28 12:42:28 +03:00
Joonas Koivunen
18f4eb2622
timeline: remove compare_arced_layers
2023-08-28 12:42:28 +03:00
Joonas Koivunen
2caa8bcc23
layer_manager: more clippy
2023-08-28 12:42:28 +03:00
Joonas Koivunen
bb222abde1
layer_manager: remove metrics, dependend by gc/compaction
2023-08-28 12:42:28 +03:00
Joonas Koivunen
dd2b4ad26f
layer_manager: cleanup unused
2023-08-28 12:42:28 +03:00
Joonas Koivunen
b65cb8ea05
storage_layer: we no longer clone for residency change
2023-08-28 12:42:28 +03:00
Joonas Koivunen
3a7efc10a0
timeline: cleanup unused imports
2023-08-28 12:42:28 +03:00
Joonas Koivunen
a682de1dba
Timeline: get_value_reconstruct_data: avoid warnings
2023-08-28 12:42:28 +03:00
