perf(remote): cache schema of remote tables (#3015)

Browse Source

Caches the schema of remote tables and invalidates the cache when:

1. After 30 second TTL
2. When we do an operation that changes schema (e.g. add_columns) or
checks out a different version (e.g. checkout_version)
3. When we get a 400, 404, or 500 reponse

If the schema is retrieved close to the TTL, we optimistically fetch the
schema in the background. This means a continuous stream of queries will
never have the schema fetch on the critical path.

Closes #3014

---------

Co-authored-by: Claude Sonnet 4.5 <noreply@anthropic.com>

...

This commit is contained in:

Will Jones

2026-02-13 15:21:04 -08:00

committed by GitHub

co-authored by Claude Sonnet 4.5

parent dcb1443143

commit 2d60ea6938

1 changed files with 1138 additions and 10 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

rust/lancedb/src/remote/table.rs

+1138 -10

File diff suppressed because it is too large Load Diff