Struct ObjectStoreWalConfig 

pub struct ObjectStoreWalConfig {
    pub storage_provider: String,
    pub prefix: String,
    pub flush_interval: Duration,
    pub max_batch_bytes: ReadableSize,
    pub ack_mode: AckMode,
    pub max_unpersisted_bytes: ReadableSize,
    pub max_unpersisted_age: Duration,
    pub on_corrupted_segment: CorruptedSegmentAction,
}

Object store wal configurations for datanode.

Fields

storage_provider: String

Name of the storage provider that holds the WAL objects. An empty name selects the default object store.

prefix: String

Path prefix of the WAL objects inside the storage provider.

The store runs under a node prefix derived from it, see node_prefix.

flush_interval: Duration

Interval of flushing buffered entries to the object store, at least 10ms, defaults to 100ms.

max_batch_bytes: ReadableSize

The max size of a single batch object, defaults to 8MiB.

ack_mode: AckMode

When an append returns, defaults to durable.

max_unpersisted_bytes: ReadableSize

Size of the unpersisted backlog at which appends stall until an upload completes in enqueued mode, defaults to 64MiB.

max_unpersisted_age: Duration

Age of the oldest unpersisted entry at which appends stall until an upload completes in enqueued mode, defaults to 8s.

on_corrupted_segment: CorruptedSegmentAction

What a read does with a segment that still does not decode after a second fetch, because its checksum does not match or its content disagrees with its footer entry, defaults to skip.

Implementations

impl ObjectStoreWalConfig

pub fn node_prefix(&self, node_id: u64, generation: u64) -> String

Returns the prefix the store of node_id runs under in generation: <prefix>/datanodes/<node_id>/epochs/<generation>.

Every place that names the store’s prefix, whether to open the store or to allocate the WAL options of a region, must derive it here so the prefix a region persists matches the one its store runs under.

Trait Implementations

impl Clone for ObjectStoreWalConfig

fn clone(&self) -> ObjectStoreWalConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ObjectStoreWalConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for ObjectStoreWalConfig

fn default() -> Self

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for ObjectStoreWalConfig

where ObjectStoreWalConfig: Default,

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Eq for ObjectStoreWalConfig

impl PartialEq for ObjectStoreWalConfig

fn eq(&self, other: &ObjectStoreWalConfig) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Serialize for ObjectStoreWalConfig

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for ObjectStoreWalConfig