jasonz-lance ecf44fed4a feat(python): prefetch upcoming blocks in the background for 2-phase reads ...

_TwoPhaseSplitReader now schedules background fetches for the next few
not-yet-loaded blocks the read plan is about to need, via a small
private ThreadPoolExecutor sized by prefetch_depth (wired to
io_queue_depth). A later __getitems__ call usually finds the block
already fetched instead of blocking on storage, overlapping this
split's own I/O with whatever is consuming its previous blocks -- the
same benefit io_queue_depth already gives 1-phase, now extended inside
a single 2-phase split too.

Each reader's executor is shut down via a new close() method, called
from _iter_owned's cleanup (and _estimate_blocks_per_epoch's sampling
loop) since a fresh set of readers is built on every iteration.

2026-09-30 13:49:16 -07:00

..

lancedb

feat(python): prefetch upcoming blocks in the background for 2-phase reads

2026-09-30 13:49:16 -07:00

tests

feat!: replace get_job/job_history with describe_job/query_job_events (#4130)

2026-09-05 16:24:23 -07:00

type_tests

fix(python): expose inline types to downstream checkers (#3817)

2026-08-07 17:31:42 +08:00