Implement lazy iterators for: - secrets - views - jobs - functions - materialized views
19 KiB
@lancedb/lancedb • Docs
@lancedb/lancedb / Connection
Class: abstract Connection
A LanceDB Connection that allows you to open tables and create new ones.
Connection could be local against filesystem or remote against a server.
A Connection is intended to be a long lived object and may hold open resources such as HTTP connection pools. This is generally fine and a single connection should be shared if it is going to be used many times. However, if you are finished with a connection, you may call close to eagerly free these resources. Any call to a Connection method after it has been closed will result in an error.
Closing a connection is optional. Connections will automatically be closed when they are garbage collected.
Any created tables are independent and will continue to work even if the underlying connection has been closed.
Methods
cancelJob()
abstract cancelJob(jobId): Promise<boolean>
Request cancellation of a server-side job by id.
Resolves to true if the server accepted the cancellation, false if no such job exists. Cancelling an already-terminal job is a no-op success.
Parameters
- jobId:
string
Returns
Promise<boolean>
cloneTable()
abstract cloneTable(
targetTableName,
sourceUri,
options?): Promise<Table>
Clone a table from a source table.
A shallow clone creates a new table that shares the underlying data files with the source table but has its own independent manifest. This allows both the source and cloned tables to evolve independently while initially sharing the same data, deletion, and index files.
Parameters
-
targetTableName:
stringThe name of the target table to create. -
sourceUri:
stringThe URI of the source table to clone from. -
options? Clone options.
-
options.isShallow?:
booleanWhether to perform a shallow clone (defaults to true). -
options.sourceTag?:
stringThe tag of the source table to clone. -
options.sourceVersion?:
numberThe version of the source table to clone. -
options.targetNamespacePath?:
string[] The namespace path for the target table (defaults to root namespace).
Returns
Promise<Table>
close()
abstract close(): void
Close the connection, releasing any underlying resources.
It is safe to call this method multiple times.
Any attempt to use the connection after it is closed will result in an error.
Returns
void
createEmptyTable()
createEmptyTable(name, schema, options)
abstract createEmptyTable(
name,
schema,
options?): Promise<Table>
Creates a new empty Table
Parameters
-
name:
stringThe name of the table. -
schema:
SchemaLikeThe schema of the table -
options?:
Partial<CreateTableOptions> Additional options (backwards compatibility)
Returns
Promise<Table>
createEmptyTable(name, schema, namespacePath, options)
abstract createEmptyTable(
name,
schema,
namespacePath?,
options?): Promise<Table>
Creates a new empty Table
Parameters
-
name:
stringThe name of the table. -
schema:
SchemaLikeThe schema of the table -
namespacePath?:
string[] The namespace path to create the table in (defaults to root namespace) -
options?:
Partial<CreateTableOptions> Additional options
Returns
Promise<Table>
createMaterializedView()
abstract createMaterializedView(
name,
source,
options?): Promise<MaterializedView>
Define a materialized view named name over the table source.
The view is populated before creation returns. Set withNoData to create
only its definition and empty backing table. The view is a normal table:
it can be queried, indexed and searched, and it appears in tableNames.
Parameters
-
name:
string -
source:
string -
options?
-
options.limit?:
number -
options.select?:
MaterializedViewSelect -
options.where?:
string -
options.withNoData?:
boolean
Returns
Promise<MaterializedView>
createNamespace()
abstract createNamespace(namespacePath, options?): Promise<CreateNamespaceResponse>
Create a new namespace at the given path.
Parameters
-
namespacePath:
string[] The namespace path to create. -
options?:
Partial<CreateNamespaceOptions> Creationmode("create" | "exist_ok" | "overwrite") and optionalpropertiesto attach to the namespace.
Returns
Promise<CreateNamespaceResponse>
The properties of the created namespace and an optional transaction id.
createTable()
createTable(options, namespacePath)
abstract createTable(options, namespacePath?): Promise<Table>
Creates a new Table and initialize it with new data.
Parameters
-
options:
object&Partial<CreateTableOptions> The options object. -
namespacePath?:
string[] The namespace path to create the table in (defaults to root namespace)
Returns
Promise<Table>
createTable(name, data, options)
abstract createTable(
name,
data,
options?): Promise<Table>
Creates a new Table and initialize it with new data.
Parameters
-
name:
stringThe name of the table. -
data:
TableLike|Record<string,unknown>[] Non-empty Array of Records to be inserted into the table -
options?:
Partial<CreateTableOptions> Additional options (backwards compatibility)
Returns
Promise<Table>
createTable(name, data, namespacePath, options)
abstract createTable(
name,
data,
namespacePath?,
options?): Promise<Table>
Creates a new Table and initialize it with new data.
Parameters
-
name:
stringThe name of the table. -
data:
TableLike|Record<string,unknown>[] Non-empty Array of Records to be inserted into the table -
namespacePath?:
string[] The namespace path to create the table in (defaults to root namespace) -
options?:
Partial<CreateTableOptions> Additional options
Returns
Promise<Table>
createView()
abstract createView(
name,
query,
namespacePath?): Promise<ViewDescription>
Create a view: a named query the database plans on every read.
The query is planned once, at creation, so one that cannot be planned is rejected now rather than at the first read. A view holds no rows, and its readers see its sources as they are at read time.
There is no replace: a name already taken is an error, and changing a view is a drop followed by a create.
Parameters
-
name:
string -
query:
string -
namespacePath?:
string[]
Returns
Promise<ViewDescription>
describeNamespace()
abstract describeNamespace(namespacePath): Promise<DescribeNamespaceResponse>
Describe a namespace, returning its properties.
Parameters
- namespacePath:
string[] The namespace path to describe, in parent → child order, e.g.["analytics", "sales"].
Returns
Promise<DescribeNamespaceResponse>
The namespace's properties (may be undefined if the namespace has none).
describeView()
abstract describeView(name, namespacePath?): Promise<ViewDescription>
What this database records about the view named name: its defining
query and the schema that query resolved to.
Parameters
-
name:
string -
namespacePath?:
string[]
Returns
Promise<ViewDescription>
display()
abstract display(): string
Return a brief description of the connection
Returns
string
dropAllTables()
abstract dropAllTables(namespacePath?): Promise<void>
Drop all tables in the database.
Parameters
- namespacePath?:
string[] The namespace path to drop tables from (defaults to root namespace).
Returns
Promise<void>
dropMaterializedView()
abstract dropMaterializedView(name, namespacePath?): Promise<void>
Drop the materialized view named name.
The view may become unavailable before physical cleanup finishes. Use dropMaterializedViewAsync to retain and wait for the cleanup job.
Rejects a table that exists but is not a materialized view.
Parameters
-
name:
string -
namespacePath?:
string[]
Returns
Promise<void>
dropMaterializedViewAsync()
abstract dropMaterializedViewAsync(name, namespacePath?): Promise<Job>
Start dropping the materialized view named name and return its cleanup
job without waiting for completion.
Rejects a table that exists but is not a materialized view.
Parameters
-
name:
string -
namespacePath?:
string[]
Returns
Promise<Job>
dropNamespace()
abstract dropNamespace(namespacePath, options?): Promise<DropNamespaceResponse>
Drop a namespace.
Use behavior: "cascade" to also drop everything contained in the
namespace (sub-namespaces and tables). The default "restrict"
behavior refuses to drop a non-empty namespace.
Parameters
-
namespacePath:
string[] The namespace path to drop. -
options?:
Partial<DropNamespaceOptions>mode("skip" | "fail" for missing-namespace handling) andbehavior("restrict" | "cascade").
Returns
Promise<DropNamespaceResponse>
Any properties returned by the server and an optional transaction id.
dropTable()
abstract dropTable(name, namespacePath?): Promise<void>
Drop an existing table.
Parameters
-
name:
stringThe name of the table to drop. -
namespacePath?:
string[] The namespace path of the table (defaults to root namespace).
Returns
Promise<void>
dropTableAsync()
abstract dropTableAsync(name, namespacePath?): Promise<Job>
Start dropping a table and return its cleanup job.
The table may become unavailable before its data files are removed. Wait on the returned job to know when cleanup has finished.
Parameters
-
name:
string -
namespacePath?:
string[]
Returns
Promise<Job>
dropView()
abstract dropView(name, namespacePath?): Promise<void>
Drop the view named name and wait for its definition to be deleted.
The tables it reads are untouched: a view holds no rows of its own. Use dropViewAsync to retain the cleanup job instead of waiting on it.
Parameters
-
name:
string -
namespacePath?:
string[]
Returns
Promise<void>
dropViewAsync()
abstract dropViewAsync(name, namespacePath?): Promise<Job>
Start dropping the view named name and return the job deleting its
definition, without waiting for completion.
The name is free before this resolves. When nothing was bound to it, the returned job is already finished and has no id.
Parameters
-
name:
string -
namespacePath?:
string[]
Returns
Promise<Job>
isOpen()
abstract isOpen(): boolean
Return true if the connection has not been closed
Returns
boolean
listJobs()
abstract listJobs(options?): Listing<JobInfo>
Iterate lazily over server-side jobs across the database's tables.
Use for await...of. Options control page size and the starting token.
See Listing for pagination state and error behavior.
Parameters
- options?:
ListingOptions
Returns
listMaterializedViews()
abstract listMaterializedViews(options?): Listing<string>
The names of the materialized views in this database.
Iterate lazily with for await...of. Local listings inspect table schemas
one page at a time. Options control page size and the starting token.
See Listing for pagination state and error behavior.
Parameters
- options?:
ListingOptions
Returns
Listing<string>
listNamespaces()
abstract listNamespaces(namespacePath?, options?): Promise<ListNamespacesResponse>
List the immediate child namespaces under the given parent.
Results may be paginated. To retrieve subsequent pages, pass the
pageToken returned by a previous call.
Parameters
-
namespacePath?:
string[] The parent namespace path. Defaults to the root namespace if omitted. -
options?:
Partial<ListNamespacesOptions> Pagination options (pageToken,limit).
Returns
Promise<ListNamespacesResponse>
Child namespace names and an optional token for fetching the next page.
listTables()
listTables(options)
abstract listTables(options?): Promise<ListTablesResponse>
List a page of the tables in this database.
To retrieve the tables after the page, pass the pageToken the response
carries back in. A page can be shorter than limit without being the last
one, so walk until a response carries no page token:
const names = [];
let pageToken = undefined;
do {
const page = await conn.listTables({ pageToken, limit: 100 });
names.push(...page.tables);
pageToken = page.pageToken;
} while (pageToken);
Parameters
- options?:
Partial<ListTablesOptions> Pagination options (pageToken,limit).
Returns
Promise<ListTablesResponse>
A page of table names and an optional token for the tables after it.
listTables(namespacePath, options)
abstract listTables(namespacePath?, options?): Promise<ListTablesResponse>
List a page of the tables in this database.
Parameters
-
namespacePath?:
string[] The namespace path to list tables from (defaults to root namespace) -
options?:
Partial<ListTablesOptions> Pagination options (pageToken,limit).
Returns
Promise<ListTablesResponse>
A page of table names and an optional token for the tables after it.
listViews()
abstract listViews(namespacePath?, options?): Listing<string>
The names of the views in one namespace.
Names only; a definition comes from describeView.
Iterate lazily with for await...of. See Listing for pagination
state and error behavior; options control page size and the starting token.
Parameters
-
namespacePath?:
string[] -
options?:
ListingOptions
Returns
Listing<string>
openJob()
abstract openJob(jobId): Promise<Job>
Open a server-side job by id, returning a handle with its record already populated. Rejects when the server has no such job, the way Connection.openTable does for a missing table.
The returned Job answers for its own state, specification, result, failure and event history, so there is no separate connection-level call for any of them.
Parameters
- jobId:
string
Returns
Promise<Job>
openMaterializedView()
abstract openMaterializedView(name): Promise<MaterializedView>
Open the materialized view named name.
Rejects a table that exists but is not a materialized view.
Parameters
- name:
string
Returns
Promise<MaterializedView>
openTable()
abstract openTable(
name,
namespacePath?,
options?): Promise<Table>
Parameters
-
name:
string -
namespacePath?:
string[] -
options?:
Partial<OpenTableOptions>
Returns
Promise<Table>
pauseJob()
abstract pauseJob(jobId): Promise<string>
Pause a server-side job by id.
The job's workers drain and it stays parked until resumed. Resolves to "pausing", "already_paused", or "committing" -- a job finalizing its results cannot be parked; retry shortly.
Parameters
- jobId:
string
Returns
Promise<string>
renameTable()
abstract renameTable(
currentName,
newName,
options?): Promise<void>
Rename a table.
Currently only supported by LanceDB Cloud. Local OSS connections and namespace-backed connections (via connectNamespace) reject with a "not supported" error.
Parameters
-
currentName:
stringThe current name of the table. -
newName:
stringThe new name for the table. -
options?:
RenameTableOptionsOptional namespace paths. WhennewNamespacePathis omitted the table stays innamespacePath.
Returns
Promise<void>
resumeJob()
abstract resumeJob(jobId): Promise<string>
Resume a paused server-side job by id.
Its workers pick their work back up from checkpoints. Resolves to "resumed", "still_pausing" -- the pause's worker drain is not confirmed yet; retry shortly -- or "not_paused".
Parameters
- jobId:
string
Returns
Promise<string>
tableNames()
tableNames(options)
abstract tableNames(options?): Promise<string[]>
List all the table names in this database.
Tables will be returned in lexicographical order.
Parameters
- options?:
Partial<TableNamesOptions> options to control the paging / start point (backwards compatibility)
Returns
Promise<string[]>
Deprecated
Use Connection.listTables instead.
tableNames(namespacePath, options)
abstract tableNames(namespacePath?, options?): Promise<string[]>
List all the table names in this database.
Tables will be returned in lexicographical order.
Parameters
-
namespacePath?:
string[] The namespace path to list tables from (defaults to root namespace) -
options?:
Partial<TableNamesOptions> options to control the paging / start point
Returns
Promise<string[]>
Deprecated
Use Connection.listTables instead.