Skip to main content

Module export_logical_tables

Module export_logical_tables 

Source
Expand description

Internal physical-table export into logical-table Parquet files.

Callers must authorize the captured tables and destination before invoking this component, and keep the source stable. Each destination must be owned exclusively by the export attempt. Completion and cleanup of closed files belong to the caller’s chunk protocol, not individual file completion.

ModulesΒ§

writers πŸ”’

StructsΒ§

ActiveWriter πŸ”’
LogicalTableExport
Metadata captured for one physical table and its selected logical tables. Construct one unit per physical table, schema and time chunk. Capturing these references supplies no snapshot isolation or locking guarantee.
LogicalTableExportLimits
Export preprocessing and per-file limits. Query memory and spill remain governed by the query engine. Batch checks happen after allocation; flush thresholds are not hard RSS caps.
LogicalTableExportSummary
Counts returned only after every selected logical file has been closed.
LogicalTableProjection πŸ”’

FunctionsΒ§

check_cancelled πŸ”’
convert_slice_payload πŸ”’
estimate_batch_bytes_upper_bound πŸ”’
Estimates a conservative byte upper bound with bounded work on an async task. None means this path cannot estimate the batch, not that it exceeds a budget.
estimate_value_size πŸ”’
expand_bounded_slice πŸ”’
expand_export_array πŸ”’
expand_export_batch πŸ”’
Limits nested casts to selected children: Arrow’s List cast otherwise expands the entire values array, even when the parent has been sliced.
export_stream_managed πŸ”’
map_writer_error πŸ”’
rows_within_budget πŸ”’
write_tables πŸ”’