From 7f272543923aff2ab8f8b6d3761ec1d24172b4dc Mon Sep 17 00:00:00 2001 From: Alex Chi Z Date: Fri, 25 Apr 2025 15:44:16 -0400 Subject: [PATCH] layer file migration Signed-off-by: Alex Chi Z --- docs/rfcs/2025-04-14-storage-keys.md | 7 +++++++ 1 file changed, 7 insertions(+) diff --git a/docs/rfcs/2025-04-14-storage-keys.md b/docs/rfcs/2025-04-14-storage-keys.md index 594a15acf6..1244129c2c 100644 --- a/docs/rfcs/2025-04-14-storage-keys.md +++ b/docs/rfcs/2025-04-14-storage-keys.md @@ -99,6 +99,12 @@ If data compression is enabled, the data is compressed first before being encryp This file format is used across both object storage and local storage. We do not decrypt when downloading the layer file to the disk. Decryption is done when reading the layer. +### Layer File Format Migration + +We record the file format for each of the layer file in both the index_part and the layer file name (suffix v2?). +The layer file format version will be passed into the layer readers. The re-keying operation (described below) +will migrate all layer files automatically to v2. + ### Safekeeper Segment Format TBD @@ -113,6 +119,7 @@ exact timeline key being used to encrypt the layer file). ``` # LayerFileMetadata { + "format": 2, "created_at": "