Publish metrics showing how far each out-of-process log consumer trails
the newest data in the directories this node logs to, so that operators
can tell whether a consumer is keeping up. Covers both the
configure_local_logs and kumo.jsonl.new_writer directories.
When a record exceeds the configured max_line_size, discard just that record
and continue reading the rest of the segment instead of aborting the entire
segment.
The zstd decompression buffer now grows on demand to read records up to
a configurable 128 MiB cap. Oversized records are rejected explicitly
both on read and write, with matching limits so all written records are
guaranteed readable.