Expand description
Internal physical-table export into logical-table Parquet files.
Callers must authorize the captured tables and destination before invoking this component, and keep the source stable. Each destination must be owned exclusively by the export attempt. Completion and cleanup of closed files belong to the callerβs chunk protocol, not individual file completion.
ModulesΒ§
- writers π
StructsΒ§
- Active
Writer π - Logical
Table Export - Metadata captured for one physical table and its selected logical tables. Construct one unit per physical table, schema and time chunk. Capturing these references supplies no snapshot isolation or locking guarantee.
- Logical
Table Export Limits - Export preprocessing and per-file limits. Query memory and spill remain governed by the query engine. Batch checks happen after allocation; flush thresholds are not hard RSS caps.
- Logical
Table Export Summary - Counts returned only after every selected logical file has been closed.
- Logical
Table πProjection
FunctionsΒ§
- check_
cancelled π - convert_
slice_ πpayload - estimate_
batch_ πbytes_ upper_ bound - Estimates a conservative byte upper bound with bounded work on an async task.
Nonemeans this path cannot estimate the batch, not that it exceeds a budget. - estimate_
value_ πsize - expand_
bounded_ πslice - expand_
export_ πarray - expand_
export_ πbatch - Limits nested casts to selected children: Arrowβs List cast otherwise expands the entire values array, even when the parent has been sliced.
- export_
stream_ πmanaged - map_
writer_ πerror - rows_
within_ πbudget - write_
tables π