Re-exports§
pub use recordbatch::RecordBatch;
Modules§
- adapter
- cursor
- error
- Error of record batch.
- ext
- filter
- Precise single-column predicates and record batch filtering.
- memory 🔒
- Scan memory reservations held for reader lifetimes.
- recordbatch
- util
Structs§
- Binary
Formatter 🔒 - Binary
Formatter 🔒Factory - Callback
Memory 🔒Metrics - Callback
Memory 🔒Metrics Inner - DfRecord
Batch - A two-dimensional batch of column-oriented data with a defined schema.
- Empty
Record Batch Stream - EmptyRecordBatchStream can be used to create a RecordBatchStream that will produce no results
- Memory
Tracked Stream - A wrapper stream that tracks memory usage of RecordBatches.
- Order
Option - Query
Memory Reservation - Reserved scan memory, released automatically on drop.
- Query
Memory Tracker - Memory tracker for RecordBatch streams and reader reservations. Clone to share the same limit across queries. Limited accounting rounds up to KB; unlimited accounting is byte-exact. Exhaustion fails immediately. DataFusion operators use the separate query runtime pool.
- Query
Memory Tracker Builder - Builder for constructing a
QueryMemoryTrackerwith optional callbacks. - Record
Batch Stream Wrapper - Adapt a [Stream] of RecordBatch to a RecordBatchStream.
- Record
Batches - Sendable
Record Batch Mapper - A wrapper that maps a RecordBatchStream to a new RecordBatchStream by applying a function to each RecordBatch.
- Simple
Record Batch Stream - Stream
Memory 🔒Tracker
Traits§
Functions§
- map_
dictionary_ to_ values - Expands dictionary arrays to their value arrays according to
mapped_schema. - map_
dictionary_ to_ values_ data_ type - Replaces dictionary types with their value types, including dictionaries nested in lists and structs.
- map_
dictionary_ to_ values_ schema - Maps dictionary columns in a schema to their value types.
- map_
json_ type_ to_ string - Maps the json type to string in the batch.
- map_
json_ type_ to_ string_ schema - Maps the json type to string in the schema.
Type Aliases§
- DfSendable
Record Batch Stream - Trait for a [
Stream] ofRecordBatches that can be passed between threads - Reject
Callback 🔒 - Sendable
Record Batch Stream - Unit
Callback 🔒 - Update
Callback 🔒