Heikki Linnakangas 556422f9bb Use a chunked byte buffer to hold page versions in in-memory layer. ...

Change the way the page versions are stored in an in-memory layer.
Instead of storing the original PageVersion structs, serialize them
into an expandable buffer. That has a couple of advantages: first, the
serialized form is more compact, which greatly reduces the memory
usage. Secondly, we can track the memory used more accurately.

This moves the serialization work from the checkpointer to the WAL
receiver. It also means that if a page in an in-memory layer is
accessed, it needs to be deserialized on the GetPage call. That's adds
a bit of latency, but it's not significant compared to the overhead of
replaying WAL records. The simpler memory accounting is worth it.

Per Konstantin's idea a long time ago.

2021-11-04 15:09:32 -07:00

..

src

Use a chunked byte buffer to hold page versions in in-memory layer.

2021-11-04 15:09:32 -07:00

tests

Implement graceful shutdown at 'pageserver stop':

2021-10-11 13:35:01 +03:00

build.rs

Propagate git SHA to zenith binaries

2021-11-04 14:22:29 +03:00

Cargo.toml

Propagate git SHA to zenith binaries

2021-11-04 14:22:29 +03:00