Struct Json2Aligner 

pub(crate) struct Json2Aligner {
    schema: SchemaRef,
    json_columns: Vec<(usize, DataType)>,
}

Aligns concrete JSON2 Arrow types across record batches.

JSON2 column concrete Arrow types are derived from data. Different memtable parts may therefore have different concrete types for the same JSON2 column. This helper merges those concrete types and aligns batches to the merged schema.

Fields

schema: SchemaRef

Schema after merging all JSON2 column concrete types.

json_columns: Vec<(usize, DataType)>

JSON2 columns that may need per-batch alignment.

Implementations

impl Json2Aligner

pub(crate) fn try_new<I>(input_schemas: I) -> Result<Self>

where I: IntoIterator<Item = SchemaRef>,

Builds an aligner from input schemas.

Note: except for JSON2 columns, all input schemas must be identical.

pub(crate) fn schema(&self) -> &SchemaRef

Returns the aligned output schema.

pub(crate) fn align_batch(&self, batch: RecordBatch) -> Result<RecordBatch>

Aligns a [RecordBatch] to Self::schema.

pub(crate) fn align_batches<I>(&self, batches: I) -> Result<Vec<RecordBatch>>

where I: IntoIterator<Item = RecordBatch>,

Aligns [RecordBatch]s to Self::schema.

pub(crate) fn wrap_iter( &self, iter: BoxedRecordBatchIterator, ) -> BoxedRecordBatchIterator

Wraps an iterator so each yielded [RecordBatch] is lazily aligned.

Trait Implementations

impl Clone for Json2Aligner

fn clone(&self) -> Json2Aligner

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.