mirror of
https://github.com/lancedb/lancedb.git
synced 2026-11-18 16:43:59 +00:00
feat(nodejs): expose Function refresh publication intervals (#4957)
Expose `publicationIntervalRows` on TypeScript refresh options and
forward it as `publication_interval_rows`. Accept positive safe integers
and preserve whole-fragment publication when omitted.
```typescript
const job = await table.refreshColumnAsync("embedding", {
publicationIntervalRows: 10000,
});
await job.wait();
```
Document the threshold semantics and add coverage for serialization,
omission, invalid values, safe-integer boundaries, and Embedded
rejection.
Closes ENT-3755.
This commit is contained in:
@@ -808,6 +808,11 @@ export abstract class Table {
|
||||
* `resourceBudget` for registered Functions. All are LanceDB Enterprise
|
||||
* only; a LanceDB Embedded refresh rejects every option other than
|
||||
* `batchSize`, `gpuClass` and `gpuCount`.
|
||||
* `publicationIntervalRows` opts into publishing completed Function split
|
||||
* ranges once their accumulated unpublished rows reach the threshold.
|
||||
* It must be a positive safe integer and requires non-Blob Function outputs.
|
||||
* Omit it for whole-fragment publication. Publications can exceed the
|
||||
* threshold, and remaining rows publish at completion.
|
||||
* @example
|
||||
* ```ts
|
||||
* const job = await table.refreshColumnAsync("embedding", {
|
||||
@@ -817,6 +822,7 @@ export abstract class Table {
|
||||
* memoryBytes: 16 * 1024 ** 3,
|
||||
* },
|
||||
* maxConcurrency: 4,
|
||||
* publicationIntervalRows: 10000,
|
||||
* errorPolicy: "skip",
|
||||
* maxFailedFraction: 0.01,
|
||||
* rowTimeoutSeconds: 30,
|
||||
|
||||
Reference in New Issue
Block a user