tests pass; still need catalog

almost
initial changes to enable an in-memory dataset
2025-12-24 13:59:58 +00:00 · 2023-12-21 20:13:08 -08:00 · 2023-12-21 19:45:10 -08:00 · 2023-12-21 08:52:11 -08:00
45 changed files with 465 additions and 1720 deletions
--- a/.bumpversion.cfg
+++ b/.bumpversion.cfg
@@ -1,5 +1,5 @@
 [bumpversion]
-current_version = 0.4.1
+current_version = 0.4.0
 commit = True
 message = Bump version: {current_version} → {new_version}
 tag = True
--- a/docs/src/embeddings/default_embedding_functions.md
+++ b/docs/src/embeddings/default_embedding_functions.md
@@ -1,9 +1,9 @@
-There are various Embedding functions available out of the box with LanceDB. We're working on supporting other popular embedding APIs.
+There are various Embedding functions available out of the box with lancedb. We're working on supporting other popular embedding APIs.

 ## Text Embedding Functions
 Here are the text embedding functions registered by default.
-Embedding functions have an inbuilt rate limit handler wrapper for source and query embedding function calls that retry with exponential standoff. 
-Each `EmbeddingFunction` implementation automatically takes `max_retries` as an argument which has the default value of 7.
+Embedding functions have inbuilt rate limit handler wrapper for source and query embedding function calls that retry with exponential standoff. 
+Each `EmbeddingFunction` implementation automatically takes `max_retries` as an argument which has the deafult value of 7.

 ### Sentence Transformers
 Here are the parameters that you can set when registering a `sentence-transformers` object, and their default values:
@@ -69,15 +69,15 @@ print(actual.text)
 ```

 ### Instructor Embeddings
-Instructor is an instruction-finetuned text embedding model that can generate text embeddings tailored to any task (e.g. classification, retrieval, clustering, text evaluation, etc.) and domains (e.g. science, finance, etc.) by simply providing the task instruction, without any finetuning.
+Instructor is an instruction-finetuned text embedding model that can generate text embeddings tailored to any task (e.g., classification, retrieval, clustering, text evaluation, etc.) and domains (e.g., science, finance, etc.) by simply providing the task instruction, without any finetuning

 If you want to calculate customized embeddings for specific sentences, you may follow the unified template to write instructions:

                          Represent the `domain` `text_type` for `task_objective`:

-* `domain` is optional, and it specifies the domain of the text, e.g. science, finance, medicine, etc.
-* `text_type` is required, and it specifies the encoding unit, e.g. sentence, document, paragraph, etc.
-* `task_objective` is optional, and it specifies the objective of embedding, e.g. retrieve a document, classify the sentence, etc.
+* `domain` is optional, and it specifies the domain of the text, e.g., science, finance, medicine, etc.
+* `text_type` is required, and it specifies the encoding unit, e.g., sentence, document, paragraph, etc.
+* `task_objective` is optional, and it specifies the objective of embedding, e.g., retrieve a document, classify the sentence, etc.

 More information about the model can be found here - https://github.com/xlang-ai/instructor-embedding

@@ -119,10 +119,10 @@ tbl.add(texts)
 ```

 ## Multi-modal embedding functions
-Multi-modal embedding functions allow you to query your table using both images and text.
+Multi-modal embedding functions allow you query your table using both images and text.

 ### OpenClipEmbeddings
-We support CLIP model embeddings using the open source alternative, open-clip which supports various customizations. It is registered as `open-clip` and supports the following customizations:
+We support CLIP model embeddings using the open souce alternbative, open-clip which support various customizations. It is registered as `open-clip` and supports following customizations.


 | Parameter | Type | Default Value | Description |
@@ -205,4 +205,4 @@ print(actual.label)

 ```

-If you have any questions about the embeddings API, supported models, or see a relevant model missing, please raise an issue.
+If you have any questions about the embeddings API, supported models, or see a relevant model missing, please raise an issue.
--- a/docs/src/guides/tables.md
+++ b/docs/src/guides/tables.md
@@ -1,7 +1,5 @@
 <a href="https://colab.research.google.com/github/lancedb/lancedb/blob/main/docs/src/notebooks/tables_guide.ipynb"><img src="https://colab.research.google.com/assets/colab-badge.svg" alt="Open In Colab"></a><br/>
-A Table is a collection of Records in a LanceDB Database. Tables in Lance have a schema that defines the columns and their types. These schemas can include nested columns and can evolve over time.
-
-This guide will show how to create tables, insert data into them, and update the data. You can follow along on colab!
+A Table is a collection of Records in a LanceDB Database. You can follow along on colab!

 ## Creating a LanceDB Table

@@ -363,28 +361,19 @@ Use the `delete()` method on tables to delete rows from a table. To choose which
    await tbl.countRows() // Returns 1
    ```

-## Updating a Table
+### Updating a Table [Experimental]
+EXPERIMENTAL: Update rows in the table (not threadsafe).

-This can be used to update zero to all rows depending on how many rows match the where clause. The update queries follow the form of a SQL UPDATE statement. The `where` parameter is a SQL filter that matches on the metadata columns. The `values` or `values_sql` parameters are used to provide the new values for the columns.
+This can be used to update zero to all rows depending on how many rows match the where clause.

-| Parameter   | Type | Description |
+| Parameter | Type | Description |
 |---|---|---|
 | `where` | `str` | The SQL where clause to use when updating rows. For example, `'x = 2'` or `'x IN (1, 2, 3)'`. The filter must not be empty, or it will error. |
 | `values` | `dict` | The values to update. The keys are the column names and the values are the values to set. |
-| `values_sql` | `dict` | The values to update. The keys are the column names and the values are the SQL expressions to set. For example, `{'x': 'x + 1'}` will increment the value of the `x` column by 1. |

-!!! info "SQL syntax"
-
-    See [SQL filters](sql.md) for more information on the supported SQL syntax.
-
-!!! warning "Warning"
-
-    Updating nested columns is not yet supported.

 === "Python"

-    API Reference: [lancedb.table.Table.update][]
-
    ```python
    import lancedb
    import pandas as pd
@@ -414,55 +403,6 @@ This can be used to update zero to all rows depending on how many rows match the
    2  2  [10.0, 10.0]
    ```

-=== "Javascript/Typescript"
-
-    API Reference: [vectordb.Table.update](../../javascript/interfaces/Table/#update)
-
-    ```javascript
-    const lancedb = require("vectordb");
-
-    const db = await lancedb.connect("./.lancedb");
-
-    const data = [
-      {x: 1, vector: [1, 2]},
-      {x: 2, vector: [3, 4]},
-      {x: 3, vector: [5, 6]},
-    ];
-    const tbl = await db.createTable("my_table", data)
-
-    await tbl.update({ where: "x = 2", values: {vector: [10, 10]} })
-    ```
-
-The `values` parameter is used to provide the new values for the columns as literal values. You can also use the `values_sql` / `valuesSql` parameter to provide SQL expressions for the new values. For example, you can use `values_sql="x + 1"` to increment the value of the `x` column by 1.
-
-=== "Python"
-
-    ```python
-    # Update the table where x = 2
-    table.update(valuesSql={"x": "x + 1"})
-
-    print(table.to_pandas())
-    ```
-
-    Output
-    ```shell
-        x  vector
-    0  2  [1.0, 2.0]
-    1  4  [5.0, 6.0]
-    2  3  [10.0, 10.0]
-    ```
-
-=== "Javascript/Typescript"
-
-    ```javascript
-    await tbl.update({ valuesSql: { x: "x + 1" } })
-    ```
-
-!!! info "Note"
-
-    When rows are updated, they are moved out of the index. The row will still show up in ANN queries, but the query will not be as fast as it would be if the row was in the index. If you update a large proportion of rows, consider rebuilding the index afterwards.
-
-
 ## What's Next?

 Learn how to Query your tables and create indices
--- a/docs/src/javascript/README.md
+++ b/docs/src/javascript/README.md
@@ -11,13 +11,8 @@ npm install vectordb
 ```

 This will download the appropriate native library for your platform. We currently
-support:
-
-* Linux (x86_64 and aarch64)
-* MacOS (Intel and ARM/M1/M2)
-* Windows (x86_64 only)
-
-We do not yet support musl-based Linux (such as Alpine Linux) or aarch64 Windows.
+support x86_64 Linux, aarch64 Linux, Intel MacOS, and ARM (M1/M2) MacOS. We do not
+yet support Windows or musl-based Linux (such as Alpine Linux).

 ## Usage

--- a/docs/src/javascript/classes/DefaultWriteOptions.md
+++ b/docs/src/javascript/classes/DefaultWriteOptions.md
@@ -1,41 +0,0 @@
-[vectordb](../README.md) / [Exports](../modules.md) / DefaultWriteOptions
-
-# Class: DefaultWriteOptions
-
-Write options when creating a Table.
-
-## Implements
-
- [`WriteOptions`](../interfaces/WriteOptions.md)
-
-## Table of contents
-
-### Constructors
-
- [constructor](DefaultWriteOptions.md#constructor)
-
-### Properties
-
- [writeMode](DefaultWriteOptions.md#writemode)
-
-## Constructors
-
-### constructor
-
-• **new DefaultWriteOptions**()
-
-## Properties
-
-### writeMode
-
-• **writeMode**: [`WriteMode`](../enums/WriteMode.md) = `WriteMode.Create`
-
-A [WriteMode](../enums/WriteMode.md) to use on this operation
-
-#### Implementation of
-
-[WriteOptions](../interfaces/WriteOptions.md).[writeMode](../interfaces/WriteOptions.md#writemode)
-
-#### Defined in
-
-[index.ts:778](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L778)
--- a/docs/src/javascript/classes/LocalConnection.md
+++ b/docs/src/javascript/classes/LocalConnection.md
@@ -26,7 +26,7 @@ A connection to a LanceDB database.
 ### Methods

 - [createTable](LocalConnection.md#createtable)
- [createTableImpl](LocalConnection.md#createtableimpl)
+- [createTableArrow](LocalConnection.md#createtablearrow)
 - [dropTable](LocalConnection.md#droptable)
 - [openTable](LocalConnection.md#opentable)
 - [tableNames](LocalConnection.md#tablenames)
@@ -46,7 +46,7 @@ A connection to a LanceDB database.

 #### Defined in

-[index.ts:355](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L355)
+[index.ts:184](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L184)

 ## Properties

@@ -56,25 +56,17 @@ A connection to a LanceDB database.

 #### Defined in

-[index.ts:353](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L353)
+[index.ts:182](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L182)

 ___

 ### \_options

-• `Private` `Readonly` **\_options**: () => [`ConnectionOptions`](../interfaces/ConnectionOptions.md)
-
-#### Type declaration
-
-▸ (): [`ConnectionOptions`](../interfaces/ConnectionOptions.md)
-
-##### Returns
-
-[`ConnectionOptions`](../interfaces/ConnectionOptions.md)
+• `Private` `Readonly` **\_options**: [`ConnectionOptions`](../interfaces/ConnectionOptions.md)

 #### Defined in

-[index.ts:352](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L352)
+[index.ts:181](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L181)

 ## Accessors

@@ -92,34 +84,27 @@ ___

 #### Defined in

-[index.ts:360](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L360)
+[index.ts:189](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L189)

 ## Methods

 ### createTable

-▸ **createTable**\<`T`\>(`name`, `data?`, `optsOrEmbedding?`, `opt?`): `Promise`\<[`Table`](../interfaces/Table.md)\<`T`\>\>
+▸ **createTable**(`name`, `data`, `mode?`): `Promise`<[`Table`](../interfaces/Table.md)<`number`[]\>\>

-Creates a new Table, optionally initializing it with new data.
-
-#### Type parameters
-
-| Name |
-| :------ |
-| `T` |
+Creates a new Table and initialize it with new data.

 #### Parameters

-| Name | Type |
-| :------ | :------ |
-| `name` | `string` \| [`CreateTableOptions`](../interfaces/CreateTableOptions.md)\<`T`\> |
-| `data?` | `Record`\<`string`, `unknown`\>[] |
-| `optsOrEmbedding?` | [`WriteOptions`](../interfaces/WriteOptions.md) \| [`EmbeddingFunction`](../interfaces/EmbeddingFunction.md)\<`T`\> |
-| `opt?` | [`WriteOptions`](../interfaces/WriteOptions.md) |
+| Name | Type | Description |
+| :------ | :------ | :------ |
+| `name` | `string` | The name of the table. |
+| `data` | `Record`<`string`, `unknown`\>[] | Non-empty Array of Records to be inserted into the Table |
+| `mode?` | [`WriteMode`](../enums/WriteMode.md) | The write mode to use when creating the table. |

 #### Returns

-`Promise`\<[`Table`](../interfaces/Table.md)\<`T`\>\>
+`Promise`<[`Table`](../interfaces/Table.md)<`number`[]\>\>

 #### Implementation of

@@ -127,94 +112,33 @@ Creates a new Table, optionally initializing it with new data.

 #### Defined in

-[index.ts:395](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L395)
+[index.ts:230](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L230)

-___
-
-### createTableImpl
-
-▸ `Private` **createTableImpl**\<`T`\>(`«destructured»`): `Promise`\<[`Table`](../interfaces/Table.md)\<`T`\>\>
-
-#### Type parameters
-
-| Name |
-| :------ |
-| `T` |
+▸ **createTable**(`name`, `data`, `mode`): `Promise`<[`Table`](../interfaces/Table.md)<`number`[]\>\>

 #### Parameters

 | Name | Type |
 | :------ | :------ |
-| `«destructured»` | `Object` |
-| › `data?` | `Table`\<`any`\> \| `Record`\<`string`, `unknown`\>[] |
-| › `embeddingFunction?` | [`EmbeddingFunction`](../interfaces/EmbeddingFunction.md)\<`T`\> |
-| › `name` | `string` |
-| › `schema?` | `Schema`\<`any`\> |
-| › `writeOptions?` | [`WriteOptions`](../interfaces/WriteOptions.md) |
+| `name` | `string` |
+| `data` | `Record`<`string`, `unknown`\>[] |
+| `mode` | [`WriteMode`](../enums/WriteMode.md) |

 #### Returns

-`Promise`\<[`Table`](../interfaces/Table.md)\<`T`\>\>
-
-#### Defined in
-
-[index.ts:413](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L413)
-
-___
-
-### dropTable
-
-▸ **dropTable**(`name`): `Promise`\<`void`\>
-
-Drop an existing table.
-
-#### Parameters
-
-| Name | Type | Description |
-| :------ | :------ | :------ |
-| `name` | `string` | The name of the table to drop. |
-
-#### Returns
-
-`Promise`\<`void`\>
+`Promise`<[`Table`](../interfaces/Table.md)<`number`[]\>\>

 #### Implementation of

-[Connection](../interfaces/Connection.md).[dropTable](../interfaces/Connection.md#droptable)
+Connection.createTable

 #### Defined in

-[index.ts:453](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L453)
+[index.ts:231](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L231)

-___
+▸ **createTable**<`T`\>(`name`, `data`, `mode`, `embeddings`): `Promise`<[`Table`](../interfaces/Table.md)<`T`\>\>

-### openTable
-
-▸ **openTable**(`name`): `Promise`\<[`Table`](../interfaces/Table.md)\<`number`[]\>\>
-
-Open a table in the database.
-
-#### Parameters
-
-| Name | Type | Description |
-| :------ | :------ | :------ |
-| `name` | `string` | The name of the table. |
-
-#### Returns
-
-`Promise`\<[`Table`](../interfaces/Table.md)\<`number`[]\>\>
-
-#### Implementation of
-
-[Connection](../interfaces/Connection.md).[openTable](../interfaces/Connection.md#opentable)
-
-#### Defined in
-
-[index.ts:376](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L376)
-
-▸ **openTable**\<`T`\>(`name`, `embeddings`): `Promise`\<[`Table`](../interfaces/Table.md)\<`T`\>\>
-
-Open a table in the database.
+Creates a new Table and initialize it with new data.

 #### Type parameters

@@ -227,21 +151,23 @@ Open a table in the database.
 | Name | Type | Description |
 | :------ | :------ | :------ |
 | `name` | `string` | The name of the table. |
-| `embeddings` | [`EmbeddingFunction`](../interfaces/EmbeddingFunction.md)\<`T`\> | An embedding function to use on this Table |
+| `data` | `Record`<`string`, `unknown`\>[] | Non-empty Array of Records to be inserted into the Table |
+| `mode` | [`WriteMode`](../enums/WriteMode.md) | The write mode to use when creating the table. |
+| `embeddings` | [`EmbeddingFunction`](../interfaces/EmbeddingFunction.md)<`T`\> | An embedding function to use on this Table |

 #### Returns

-`Promise`\<[`Table`](../interfaces/Table.md)\<`T`\>\>
+`Promise`<[`Table`](../interfaces/Table.md)<`T`\>\>

 #### Implementation of

-Connection.openTable
+Connection.createTable

 #### Defined in

-[index.ts:384](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L384)
+[index.ts:241](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L241)

-▸ **openTable**\<`T`\>(`name`, `embeddings?`): `Promise`\<[`Table`](../interfaces/Table.md)\<`T`\>\>
+▸ **createTable**<`T`\>(`name`, `data`, `mode`, `embeddings?`): `Promise`<[`Table`](../interfaces/Table.md)<`T`\>\>

 #### Type parameters

@@ -254,11 +180,119 @@ Connection.openTable
 | Name | Type |
 | :------ | :------ |
 | `name` | `string` |
-| `embeddings?` | [`EmbeddingFunction`](../interfaces/EmbeddingFunction.md)\<`T`\> |
+| `data` | `Record`<`string`, `unknown`\>[] |
+| `mode` | [`WriteMode`](../enums/WriteMode.md) |
+| `embeddings?` | [`EmbeddingFunction`](../interfaces/EmbeddingFunction.md)<`T`\> |

 #### Returns

-`Promise`\<[`Table`](../interfaces/Table.md)\<`T`\>\>
+`Promise`<[`Table`](../interfaces/Table.md)<`T`\>\>
+
+#### Implementation of
+
+Connection.createTable
+
+#### Defined in
+
+[index.ts:242](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L242)
+
+___
+
+### createTableArrow
+
+▸ **createTableArrow**(`name`, `table`): `Promise`<[`Table`](../interfaces/Table.md)<`number`[]\>\>
+
+#### Parameters
+
+| Name | Type |
+| :------ | :------ |
+| `name` | `string` |
+| `table` | `Table`<`any`\> |
+
+#### Returns
+
+`Promise`<[`Table`](../interfaces/Table.md)<`number`[]\>\>
+
+#### Implementation of
+
+[Connection](../interfaces/Connection.md).[createTableArrow](../interfaces/Connection.md#createtablearrow)
+
+#### Defined in
+
+[index.ts:266](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L266)
+
+___
+
+### dropTable
+
+▸ **dropTable**(`name`): `Promise`<`void`\>
+
+Drop an existing table.
+
+#### Parameters
+
+| Name | Type | Description |
+| :------ | :------ | :------ |
+| `name` | `string` | The name of the table to drop. |
+
+#### Returns
+
+`Promise`<`void`\>
+
+#### Implementation of
+
+[Connection](../interfaces/Connection.md).[dropTable](../interfaces/Connection.md#droptable)
+
+#### Defined in
+
+[index.ts:276](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L276)
+
+___
+
+### openTable
+
+▸ **openTable**(`name`): `Promise`<[`Table`](../interfaces/Table.md)<`number`[]\>\>
+
+Open a table in the database.
+
+#### Parameters
+
+| Name | Type | Description |
+| :------ | :------ | :------ |
+| `name` | `string` | The name of the table. |
+
+#### Returns
+
+`Promise`<[`Table`](../interfaces/Table.md)<`number`[]\>\>
+
+#### Implementation of
+
+[Connection](../interfaces/Connection.md).[openTable](../interfaces/Connection.md#opentable)
+
+#### Defined in
+
+[index.ts:205](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L205)
+
+▸ **openTable**<`T`\>(`name`, `embeddings`): `Promise`<[`Table`](../interfaces/Table.md)<`T`\>\>
+
+Open a table in the database.
+
+#### Type parameters
+
+| Name |
+| :------ |
+| `T` |
+
+#### Parameters
+
+| Name | Type | Description |
+| :------ | :------ | :------ |
+| `name` | `string` | The name of the table. |
+| `embeddings` | [`EmbeddingFunction`](../interfaces/EmbeddingFunction.md)<`T`\> | An embedding function to use on this Table |
+
+#### Returns
+
+`Promise`<[`Table`](../interfaces/Table.md)<`T`\>\>

 #### Implementation of

@@ -266,19 +300,46 @@ Connection.openTable

 #### Defined in

-[index.ts:385](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L385)
+[index.ts:212](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L212)
+
+▸ **openTable**<`T`\>(`name`, `embeddings?`): `Promise`<[`Table`](../interfaces/Table.md)<`T`\>\>
+
+#### Type parameters
+
+| Name |
+| :------ |
+| `T` |
+
+#### Parameters
+
+| Name | Type |
+| :------ | :------ |
+| `name` | `string` |
+| `embeddings?` | [`EmbeddingFunction`](../interfaces/EmbeddingFunction.md)<`T`\> |
+
+#### Returns
+
+`Promise`<[`Table`](../interfaces/Table.md)<`T`\>\>
+
+#### Implementation of
+
+Connection.openTable
+
+#### Defined in
+
+[index.ts:213](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L213)

 ___

 ### tableNames

-▸ **tableNames**(): `Promise`\<`string`[]\>
+▸ **tableNames**(): `Promise`<`string`[]\>

 Get the names of all tables in the database.

 #### Returns

-`Promise`\<`string`[]\>
+`Promise`<`string`[]\>

 #### Implementation of

@@ -286,4 +347,4 @@ Get the names of all tables in the database.

 #### Defined in

-[index.ts:367](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L367)
+[index.ts:196](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L196)
--- a/docs/src/javascript/classes/LocalTable.md
+++ b/docs/src/javascript/classes/LocalTable.md
@@ -1,6 +1,6 @@
 [vectordb](../README.md) / [Exports](../modules.md) / LocalTable

-# Class: LocalTable\<T\>
+# Class: LocalTable<T\>

 A LanceDB Table is the collection of Records. Each Record has one or more vector fields.

@@ -12,7 +12,7 @@ A LanceDB Table is the collection of Records. Each Record has one or more vector

 ## Implements

- [`Table`](../interfaces/Table.md)\<`T`\>
+- [`Table`](../interfaces/Table.md)<`T`\>

 ## Table of contents

@@ -26,7 +26,6 @@ A LanceDB Table is the collection of Records. Each Record has one or more vector
 - [\_name](LocalTable.md#_name)
 - [\_options](LocalTable.md#_options)
 - [\_tbl](LocalTable.md#_tbl)
- [where](LocalTable.md#where)

 ### Accessors

@@ -35,23 +34,17 @@ A LanceDB Table is the collection of Records. Each Record has one or more vector
 ### Methods

 - [add](LocalTable.md#add)
- [cleanupOldVersions](LocalTable.md#cleanupoldversions)
- [compactFiles](LocalTable.md#compactfiles)
 - [countRows](LocalTable.md#countrows)
 - [createIndex](LocalTable.md#createindex)
 - [delete](LocalTable.md#delete)
- [filter](LocalTable.md#filter)
- [indexStats](LocalTable.md#indexstats)
- [listIndices](LocalTable.md#listindices)
 - [overwrite](LocalTable.md#overwrite)
 - [search](LocalTable.md#search)
- [update](LocalTable.md#update)

 ## Constructors

 ### constructor

-• **new LocalTable**\<`T`\>(`tbl`, `name`, `options`)
+• **new LocalTable**<`T`\>(`tbl`, `name`, `options`)

 #### Type parameters

@@ -69,9 +62,9 @@ A LanceDB Table is the collection of Records. Each Record has one or more vector

 #### Defined in

-[index.ts:464](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L464)
+[index.ts:287](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L287)

-• **new LocalTable**\<`T`\>(`tbl`, `name`, `options`, `embeddings`)
+• **new LocalTable**<`T`\>(`tbl`, `name`, `options`, `embeddings`)

 #### Type parameters

@@ -86,21 +79,21 @@ A LanceDB Table is the collection of Records. Each Record has one or more vector
 | `tbl` | `any` |  |
 | `name` | `string` |  |
 | `options` | [`ConnectionOptions`](../interfaces/ConnectionOptions.md) |  |
-| `embeddings` | [`EmbeddingFunction`](../interfaces/EmbeddingFunction.md)\<`T`\> | An embedding function to use when interacting with this table |
+| `embeddings` | [`EmbeddingFunction`](../interfaces/EmbeddingFunction.md)<`T`\> | An embedding function to use when interacting with this table |

 #### Defined in

-[index.ts:471](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L471)
+[index.ts:294](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L294)

 ## Properties

 ### \_embeddings

-• `Private` `Optional` `Readonly` **\_embeddings**: [`EmbeddingFunction`](../interfaces/EmbeddingFunction.md)\<`T`\>
+• `Private` `Optional` `Readonly` **\_embeddings**: [`EmbeddingFunction`](../interfaces/EmbeddingFunction.md)<`T`\>

 #### Defined in

-[index.ts:461](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L461)
+[index.ts:284](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L284)

 ___

@@ -110,61 +103,27 @@ ___

 #### Defined in

-[index.ts:460](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L460)
+[index.ts:283](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L283)

 ___

 ### \_options

-• `Private` `Readonly` **\_options**: () => [`ConnectionOptions`](../interfaces/ConnectionOptions.md)
-
-#### Type declaration
-
-▸ (): [`ConnectionOptions`](../interfaces/ConnectionOptions.md)
-
-##### Returns
-
-[`ConnectionOptions`](../interfaces/ConnectionOptions.md)
+• `Private` `Readonly` **\_options**: [`ConnectionOptions`](../interfaces/ConnectionOptions.md)

 #### Defined in

-[index.ts:462](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L462)
+[index.ts:285](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L285)

 ___

 ### \_tbl

-• `Private` **\_tbl**: `any`
+• `Private` `Readonly` **\_tbl**: `any`

 #### Defined in

-[index.ts:459](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L459)
-
-___
-
-### where
-
-• **where**: (`value`: `string`) => [`Query`](Query.md)\<`T`\>
-
-#### Type declaration
-
-▸ (`value`): [`Query`](Query.md)\<`T`\>
-
-Creates a filter query to find all rows matching the specified criteria
-
-##### Parameters
-
-| Name | Type | Description |
-| :------ | :------ | :------ |
-| `value` | `string` | The filter criteria (like SQL where clause syntax) |
-
-##### Returns
-
-[`Query`](Query.md)\<`T`\>
-
-#### Defined in
-
-[index.ts:499](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L499)
+[index.ts:282](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L282)

 ## Accessors

@@ -182,13 +141,13 @@ Creates a filter query to find all rows matching the specified criteria

 #### Defined in

-[index.ts:479](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L479)
+[index.ts:302](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L302)

 ## Methods

 ### add

-▸ **add**(`data`): `Promise`\<`number`\>
+▸ **add**(`data`): `Promise`<`number`\>

 Insert records into this Table.

@@ -196,11 +155,11 @@ Insert records into this Table.

 | Name | Type | Description |
 | :------ | :------ | :------ |
-| `data` | `Record`\<`string`, `unknown`\>[] | Records to be inserted into the Table |
+| `data` | `Record`<`string`, `unknown`\>[] | Records to be inserted into the Table |

 #### Returns

-`Promise`\<`number`\>
+`Promise`<`number`\>

 The number of rows added to the table

@@ -210,69 +169,19 @@ The number of rows added to the table

 #### Defined in

-[index.ts:507](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L507)
-
-___
-
-### cleanupOldVersions
-
-▸ **cleanupOldVersions**(`olderThan?`, `deleteUnverified?`): `Promise`\<[`CleanupStats`](../interfaces/CleanupStats.md)\>
-
-Clean up old versions of the table, freeing disk space.
-
-#### Parameters
-
-| Name | Type | Description |
-| :------ | :------ | :------ |
-| `olderThan?` | `number` | The minimum age in minutes of the versions to delete. If not provided, defaults to two weeks. |
-| `deleteUnverified?` | `boolean` | Because they may be part of an in-progress transaction, uncommitted files newer than 7 days old are not deleted by default. This means that failed transactions can leave around data that takes up disk space for up to 7 days. You can override this safety mechanism by setting this option to `true`, only if you promise there are no in progress writes while you run this operation. Failure to uphold this promise can lead to corrupted tables. |
-
-#### Returns
-
-`Promise`\<[`CleanupStats`](../interfaces/CleanupStats.md)\>
-
-#### Defined in
-
-[index.ts:596](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L596)
-
-___
-
-### compactFiles
-
-▸ **compactFiles**(`options?`): `Promise`\<[`CompactionMetrics`](../interfaces/CompactionMetrics.md)\>
-
-Run the compaction process on the table.
-
-This can be run after making several small appends to optimize the table
-for faster reads.
-
-#### Parameters
-
-| Name | Type | Description |
-| :------ | :------ | :------ |
-| `options?` | [`CompactionOptions`](../interfaces/CompactionOptions.md) | Advanced options configuring compaction. In most cases, you can omit this arguments, as the default options are sensible for most tables. |
-
-#### Returns
-
-`Promise`\<[`CompactionMetrics`](../interfaces/CompactionMetrics.md)\>
-
-Metrics about the compaction operation.
-
-#### Defined in
-
-[index.ts:615](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L615)
+[index.ts:320](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L320)

 ___

 ### countRows

-▸ **countRows**(): `Promise`\<`number`\>
+▸ **countRows**(): `Promise`<`number`\>

 Returns the number of rows in this table.

 #### Returns

-`Promise`\<`number`\>
+`Promise`<`number`\>

 #### Implementation of

@@ -280,16 +189,20 @@ Returns the number of rows in this table.

 #### Defined in

-[index.ts:543](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L543)
+[index.ts:362](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L362)

 ___

 ### createIndex

-▸ **createIndex**(`indexParams`): `Promise`\<`any`\>
+▸ **createIndex**(`indexParams`): `Promise`<`any`\>

 Create an ANN index on this Table vector index.

+**`See`**
+
+VectorIndexParams.
+
 #### Parameters

 | Name | Type | Description |
@@ -298,11 +211,7 @@ Create an ANN index on this Table vector index.

 #### Returns

-`Promise`\<`any`\>
-
-**`See`**
-
-VectorIndexParams.
+`Promise`<`any`\>

 #### Implementation of

@@ -310,13 +219,13 @@ VectorIndexParams.

 #### Defined in

-[index.ts:536](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L536)
+[index.ts:355](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L355)

 ___

 ### delete

-▸ **delete**(`filter`): `Promise`\<`void`\>
+▸ **delete**(`filter`): `Promise`<`void`\>

 Delete rows from this table.

@@ -328,7 +237,7 @@ Delete rows from this table.

 #### Returns

-`Promise`\<`void`\>
+`Promise`<`void`\>

 #### Implementation of

@@ -336,81 +245,13 @@ Delete rows from this table.

 #### Defined in

-[index.ts:552](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L552)
-
-___
-
-### filter
-
-▸ **filter**(`value`): [`Query`](Query.md)\<`T`\>
-
-Creates a filter query to find all rows matching the specified criteria
-
-#### Parameters
-
-| Name | Type | Description |
-| :------ | :------ | :------ |
-| `value` | `string` | The filter criteria (like SQL where clause syntax) |
-
-#### Returns
-
-[`Query`](Query.md)\<`T`\>
-
-#### Defined in
-
-[index.ts:495](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L495)
-
-___
-
-### indexStats
-
-▸ **indexStats**(`indexUuid`): `Promise`\<[`IndexStats`](../interfaces/IndexStats.md)\>
-
-Get statistics about an index.
-
-#### Parameters
-
-| Name | Type |
-| :------ | :------ |
-| `indexUuid` | `string` |
-
-#### Returns
-
-`Promise`\<[`IndexStats`](../interfaces/IndexStats.md)\>
-
-#### Implementation of
-
-[Table](../interfaces/Table.md).[indexStats](../interfaces/Table.md#indexstats)
-
-#### Defined in
-
-[index.ts:628](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L628)
-
-___
-
-### listIndices
-
-▸ **listIndices**(): `Promise`\<[`VectorIndex`](../interfaces/VectorIndex.md)[]\>
-
-List the indicies on this table.
-
-#### Returns
-
-`Promise`\<[`VectorIndex`](../interfaces/VectorIndex.md)[]\>
-
-#### Implementation of
-
-[Table](../interfaces/Table.md).[listIndices](../interfaces/Table.md#listindices)
-
-#### Defined in
-
-[index.ts:624](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L624)
+[index.ts:371](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L371)

 ___

 ### overwrite

-▸ **overwrite**(`data`): `Promise`\<`number`\>
+▸ **overwrite**(`data`): `Promise`<`number`\>

 Insert records into this Table, replacing its contents.

@@ -418,11 +259,11 @@ Insert records into this Table, replacing its contents.

 | Name | Type | Description |
 | :------ | :------ | :------ |
-| `data` | `Record`\<`string`, `unknown`\>[] | Records to be inserted into the Table |
+| `data` | `Record`<`string`, `unknown`\>[] | Records to be inserted into the Table |

 #### Returns

-`Promise`\<`number`\>
+`Promise`<`number`\>

 The number of rows added to the table

@@ -432,13 +273,13 @@ The number of rows added to the table

 #### Defined in

-[index.ts:522](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L522)
+[index.ts:338](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L338)

 ___

 ### search

-▸ **search**(`query`): [`Query`](Query.md)\<`T`\>
+▸ **search**(`query`): [`Query`](Query.md)<`T`\>

 Creates a search query to find the nearest neighbors of the given search term

@@ -450,7 +291,7 @@ Creates a search query to find the nearest neighbors of the given search term

 #### Returns

-[`Query`](Query.md)\<`T`\>
+[`Query`](Query.md)<`T`\>

 #### Implementation of

@@ -458,30 +299,4 @@ Creates a search query to find the nearest neighbors of the given search term

 #### Defined in

-[index.ts:487](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L487)
-
-___
-
-### update
-
-▸ **update**(`args`): `Promise`\<`void`\>
-
-Update rows in this table.
-
-#### Parameters
-
-| Name | Type | Description |
-| :------ | :------ | :------ |
-| `args` | [`UpdateArgs`](../interfaces/UpdateArgs.md) \| [`UpdateSqlArgs`](../interfaces/UpdateSqlArgs.md) | see [UpdateArgs](../interfaces/UpdateArgs.md) and [UpdateSqlArgs](../interfaces/UpdateSqlArgs.md) for more details |
-
-#### Returns
-
-`Promise`\<`void`\>
-
-#### Implementation of
-
-[Table](../interfaces/Table.md).[update](../interfaces/Table.md#update)
-
-#### Defined in
-
-[index.ts:563](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L563)
+[index.ts:310](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L310)
--- a/docs/src/javascript/classes/OpenAIEmbeddingFunction.md
+++ b/docs/src/javascript/classes/OpenAIEmbeddingFunction.md
@@ -6,7 +6,7 @@ An embedding function that automatically creates vector representation for a giv

 ## Implements

- [`EmbeddingFunction`](../interfaces/EmbeddingFunction.md)\<`string`\>
+- [`EmbeddingFunction`](../interfaces/EmbeddingFunction.md)<`string`\>

 ## Table of contents

@@ -40,7 +40,7 @@ An embedding function that automatically creates vector representation for a giv

 #### Defined in

-[embedding/openai.ts:21](https://github.com/lancedb/lancedb/blob/7856a94/node/src/embedding/openai.ts#L21)
+[embedding/openai.ts:21](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/embedding/openai.ts#L21)

 ## Properties

@@ -50,7 +50,7 @@ An embedding function that automatically creates vector representation for a giv

 #### Defined in

-[embedding/openai.ts:19](https://github.com/lancedb/lancedb/blob/7856a94/node/src/embedding/openai.ts#L19)
+[embedding/openai.ts:19](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/embedding/openai.ts#L19)

 ___

@@ -60,7 +60,7 @@ ___

 #### Defined in

-[embedding/openai.ts:18](https://github.com/lancedb/lancedb/blob/7856a94/node/src/embedding/openai.ts#L18)
+[embedding/openai.ts:18](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/embedding/openai.ts#L18)

 ___

@@ -76,13 +76,13 @@ The name of the column that will be used as input for the Embedding Function.

 #### Defined in

-[embedding/openai.ts:50](https://github.com/lancedb/lancedb/blob/7856a94/node/src/embedding/openai.ts#L50)
+[embedding/openai.ts:50](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/embedding/openai.ts#L50)

 ## Methods

 ### embed

-▸ **embed**(`data`): `Promise`\<`number`[][]\>
+▸ **embed**(`data`): `Promise`<`number`[][]\>

 Creates a vector representation for the given values.

@@ -94,7 +94,7 @@ Creates a vector representation for the given values.

 #### Returns

-`Promise`\<`number`[][]\>
+`Promise`<`number`[][]\>

 #### Implementation of

@@ -102,4 +102,4 @@ Creates a vector representation for the given values.

 #### Defined in

-[embedding/openai.ts:38](https://github.com/lancedb/lancedb/blob/7856a94/node/src/embedding/openai.ts#L38)
+[embedding/openai.ts:38](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/embedding/openai.ts#L38)
--- a/docs/src/javascript/classes/Query.md
+++ b/docs/src/javascript/classes/Query.md
@@ -1,6 +1,6 @@
 [vectordb](../README.md) / [Exports](../modules.md) / Query

-# Class: Query\<T\>
+# Class: Query<T\>

 A builder for nearest neighbor queries for LanceDB.

@@ -23,7 +23,6 @@ A builder for nearest neighbor queries for LanceDB.
 - [\_limit](Query.md#_limit)
 - [\_metricType](Query.md#_metrictype)
 - [\_nprobes](Query.md#_nprobes)
- [\_prefilter](Query.md#_prefilter)
 - [\_query](Query.md#_query)
 - [\_queryVector](Query.md#_queryvector)
 - [\_refineFactor](Query.md#_refinefactor)
@@ -35,11 +34,9 @@ A builder for nearest neighbor queries for LanceDB.

 - [execute](Query.md#execute)
 - [filter](Query.md#filter)
- [isElectron](Query.md#iselectron)
 - [limit](Query.md#limit)
 - [metricType](Query.md#metrictype)
 - [nprobes](Query.md#nprobes)
- [prefilter](Query.md#prefilter)
 - [refineFactor](Query.md#refinefactor)
 - [select](Query.md#select)

@@ -47,7 +44,7 @@ A builder for nearest neighbor queries for LanceDB.

 ### constructor

-• **new Query**\<`T`\>(`query?`, `tbl?`, `embeddings?`)
+• **new Query**<`T`\>(`tbl`, `query`, `embeddings?`)

 #### Type parameters

@@ -59,23 +56,23 @@ A builder for nearest neighbor queries for LanceDB.

 | Name | Type |
 | :------ | :------ |
-| `query?` | `T` |
-| `tbl?` | `any` |
-| `embeddings?` | [`EmbeddingFunction`](../interfaces/EmbeddingFunction.md)\<`T`\> |
+| `tbl` | `any` |
+| `query` | `T` |
+| `embeddings?` | [`EmbeddingFunction`](../interfaces/EmbeddingFunction.md)<`T`\> |

 #### Defined in

-[query.ts:38](https://github.com/lancedb/lancedb/blob/7856a94/node/src/query.ts#L38)
+[index.ts:448](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L448)

 ## Properties

 ### \_embeddings

-• `Protected` `Optional` `Readonly` **\_embeddings**: [`EmbeddingFunction`](../interfaces/EmbeddingFunction.md)\<`T`\>
+• `Private` `Optional` `Readonly` **\_embeddings**: [`EmbeddingFunction`](../interfaces/EmbeddingFunction.md)<`T`\>

 #### Defined in

-[query.ts:36](https://github.com/lancedb/lancedb/blob/7856a94/node/src/query.ts#L36)
+[index.ts:446](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L446)

 ___

@@ -85,17 +82,17 @@ ___

 #### Defined in

-[query.ts:33](https://github.com/lancedb/lancedb/blob/7856a94/node/src/query.ts#L33)
+[index.ts:444](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L444)

 ___

 ### \_limit

-• `Private` `Optional` **\_limit**: `number`
+• `Private` **\_limit**: `number`

 #### Defined in

-[query.ts:29](https://github.com/lancedb/lancedb/blob/7856a94/node/src/query.ts#L29)
+[index.ts:440](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L440)

 ___

@@ -105,7 +102,7 @@ ___

 #### Defined in

-[query.ts:34](https://github.com/lancedb/lancedb/blob/7856a94/node/src/query.ts#L34)
+[index.ts:445](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L445)

 ___

@@ -115,27 +112,17 @@ ___

 #### Defined in

-[query.ts:31](https://github.com/lancedb/lancedb/blob/7856a94/node/src/query.ts#L31)
-
-___
-
-### \_prefilter
-
-• `Private` **\_prefilter**: `boolean`
-
-#### Defined in
-
-[query.ts:35](https://github.com/lancedb/lancedb/blob/7856a94/node/src/query.ts#L35)
+[index.ts:442](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L442)

 ___

 ### \_query

-• `Private` `Optional` `Readonly` **\_query**: `T`
+• `Private` `Readonly` **\_query**: `T`

 #### Defined in

-[query.ts:26](https://github.com/lancedb/lancedb/blob/7856a94/node/src/query.ts#L26)
+[index.ts:438](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L438)

 ___

@@ -145,7 +132,7 @@ ___

 #### Defined in

-[query.ts:28](https://github.com/lancedb/lancedb/blob/7856a94/node/src/query.ts#L28)
+[index.ts:439](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L439)

 ___

@@ -155,7 +142,7 @@ ___

 #### Defined in

-[query.ts:30](https://github.com/lancedb/lancedb/blob/7856a94/node/src/query.ts#L30)
+[index.ts:441](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L441)

 ___

@@ -165,27 +152,27 @@ ___

 #### Defined in

-[query.ts:32](https://github.com/lancedb/lancedb/blob/7856a94/node/src/query.ts#L32)
+[index.ts:443](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L443)

 ___

 ### \_tbl

-• `Private` `Optional` `Readonly` **\_tbl**: `any`
+• `Private` `Readonly` **\_tbl**: `any`

 #### Defined in

-[query.ts:27](https://github.com/lancedb/lancedb/blob/7856a94/node/src/query.ts#L27)
+[index.ts:437](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L437)

 ___

 ### where

-• **where**: (`value`: `string`) => [`Query`](Query.md)\<`T`\>
+• **where**: (`value`: `string`) => [`Query`](Query.md)<`T`\>

 #### Type declaration

-▸ (`value`): [`Query`](Query.md)\<`T`\>
+▸ (`value`): [`Query`](Query.md)<`T`\>

 A filter statement to be applied to this query.

@@ -197,17 +184,17 @@ A filter statement to be applied to this query.

 ##### Returns

-[`Query`](Query.md)\<`T`\>
+[`Query`](Query.md)<`T`\>

 #### Defined in

-[query.ts:87](https://github.com/lancedb/lancedb/blob/7856a94/node/src/query.ts#L87)
+[index.ts:496](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L496)

 ## Methods

 ### execute

-▸ **execute**\<`T`\>(): `Promise`\<`T`[]\>
+▸ **execute**<`T`\>(): `Promise`<`T`[]\>

 Execute the query and return the results as an Array of Objects

@@ -215,21 +202,21 @@ Execute the query and return the results as an Array of Objects

 | Name | Type |
 | :------ | :------ |
-| `T` | `Record`\<`string`, `unknown`\> |
+| `T` | `Record`<`string`, `unknown`\> |

 #### Returns

-`Promise`\<`T`[]\>
+`Promise`<`T`[]\>

 #### Defined in

-[query.ts:115](https://github.com/lancedb/lancedb/blob/7856a94/node/src/query.ts#L115)
+[index.ts:519](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L519)

 ___

 ### filter

-▸ **filter**(`value`): [`Query`](Query.md)\<`T`\>
+▸ **filter**(`value`): [`Query`](Query.md)<`T`\>

 A filter statement to be applied to this query.

@@ -241,31 +228,17 @@ A filter statement to be applied to this query.

 #### Returns

-[`Query`](Query.md)\<`T`\>
+[`Query`](Query.md)<`T`\>

 #### Defined in

-[query.ts:82](https://github.com/lancedb/lancedb/blob/7856a94/node/src/query.ts#L82)
-
-___
-
-### isElectron
-
-▸ `Private` **isElectron**(): `boolean`
-
-#### Returns
-
-`boolean`
-
-#### Defined in
-
-[query.ts:142](https://github.com/lancedb/lancedb/blob/7856a94/node/src/query.ts#L142)
+[index.ts:491](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L491)

 ___

 ### limit

-▸ **limit**(`value`): [`Query`](Query.md)\<`T`\>
+▸ **limit**(`value`): [`Query`](Query.md)<`T`\>

 Sets the number of results that will be returned

@@ -277,20 +250,24 @@ Sets the number of results that will be returned

 #### Returns

-[`Query`](Query.md)\<`T`\>
+[`Query`](Query.md)<`T`\>

 #### Defined in

-[query.ts:55](https://github.com/lancedb/lancedb/blob/7856a94/node/src/query.ts#L55)
+[index.ts:464](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L464)

 ___

 ### metricType

-▸ **metricType**(`value`): [`Query`](Query.md)\<`T`\>
+▸ **metricType**(`value`): [`Query`](Query.md)<`T`\>

 The MetricType used for this Query.

+**`See`**
+
+MetricType for the different options
+
 #### Parameters

 | Name | Type | Description |
@@ -299,21 +276,17 @@ The MetricType used for this Query.

 #### Returns

-[`Query`](Query.md)\<`T`\>
-
-**`See`**
-
-MetricType for the different options
+[`Query`](Query.md)<`T`\>

 #### Defined in

-[query.ts:102](https://github.com/lancedb/lancedb/blob/7856a94/node/src/query.ts#L102)
+[index.ts:511](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L511)

 ___

 ### nprobes

-▸ **nprobes**(`value`): [`Query`](Query.md)\<`T`\>
+▸ **nprobes**(`value`): [`Query`](Query.md)<`T`\>

 The number of probes used. A higher number makes search more accurate but also slower.

@@ -325,37 +298,17 @@ The number of probes used. A higher number makes search more accurate but also s

 #### Returns

-[`Query`](Query.md)\<`T`\>
+[`Query`](Query.md)<`T`\>

 #### Defined in

-[query.ts:73](https://github.com/lancedb/lancedb/blob/7856a94/node/src/query.ts#L73)
-
-___
-
-### prefilter
-
-▸ **prefilter**(`value`): [`Query`](Query.md)\<`T`\>
-
-#### Parameters
-
-| Name | Type |
-| :------ | :------ |
-| `value` | `boolean` |
-
-#### Returns
-
-[`Query`](Query.md)\<`T`\>
-
-#### Defined in
-
-[query.ts:107](https://github.com/lancedb/lancedb/blob/7856a94/node/src/query.ts#L107)
+[index.ts:482](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L482)

 ___

 ### refineFactor

-▸ **refineFactor**(`value`): [`Query`](Query.md)\<`T`\>
+▸ **refineFactor**(`value`): [`Query`](Query.md)<`T`\>

 Refine the results by reading extra elements and re-ranking them in memory.

@@ -367,17 +320,17 @@ Refine the results by reading extra elements and re-ranking them in memory.

 #### Returns

-[`Query`](Query.md)\<`T`\>
+[`Query`](Query.md)<`T`\>

 #### Defined in

-[query.ts:64](https://github.com/lancedb/lancedb/blob/7856a94/node/src/query.ts#L64)
+[index.ts:473](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L473)

 ___

 ### select

-▸ **select**(`value`): [`Query`](Query.md)\<`T`\>
+▸ **select**(`value`): [`Query`](Query.md)<`T`\>

 Return only the specified columns.

@@ -389,8 +342,8 @@ Return only the specified columns.

 #### Returns

-[`Query`](Query.md)\<`T`\>
+[`Query`](Query.md)<`T`\>

 #### Defined in

-[query.ts:93](https://github.com/lancedb/lancedb/blob/7856a94/node/src/query.ts#L93)
+[index.ts:502](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L502)
--- a/docs/src/javascript/enums/MetricType.md
+++ b/docs/src/javascript/enums/MetricType.md
@@ -22,7 +22,7 @@ Cosine distance

 #### Defined in

-[index.ts:798](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L798)
+[index.ts:567](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L567)

 ___

@@ -34,7 +34,7 @@ Dot product

 #### Defined in

-[index.ts:803](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L803)
+[index.ts:572](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L572)

 ___

@@ -46,4 +46,4 @@ Euclidean distance

 #### Defined in

-[index.ts:793](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L793)
+[index.ts:562](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L562)
--- a/docs/src/javascript/enums/WriteMode.md
+++ b/docs/src/javascript/enums/WriteMode.md
@@ -22,7 +22,7 @@ Append new data to the table.

 #### Defined in

-[index.ts:766](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L766)
+[index.ts:552](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L552)

 ___

@@ -34,7 +34,7 @@ Create a new [Table](../interfaces/Table.md).

 #### Defined in

-[index.ts:762](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L762)
+[index.ts:548](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L548)

 ___

@@ -46,4 +46,4 @@ Overwrite the existing [Table](../interfaces/Table.md) if presented.

 #### Defined in

-[index.ts:764](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L764)
+[index.ts:550](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L550)
--- a/docs/src/javascript/interfaces/AwsCredentials.md
+++ b/docs/src/javascript/interfaces/AwsCredentials.md
@@ -18,7 +18,7 @@

 #### Defined in

-[index.ts:34](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L34)
+[index.ts:31](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L31)

 ___

@@ -28,7 +28,7 @@ ___

 #### Defined in

-[index.ts:36](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L36)
+[index.ts:33](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L33)

 ___

@@ -38,4 +38,4 @@ ___

 #### Defined in

-[index.ts:38](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L38)
+[index.ts:35](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L35)
--- a/docs/src/javascript/interfaces/CleanupStats.md
+++ b/docs/src/javascript/interfaces/CleanupStats.md
@@ -1,34 +0,0 @@
-[vectordb](../README.md) / [Exports](../modules.md) / CleanupStats
-
-# Interface: CleanupStats
-
-## Table of contents
-
-### Properties
-
- [bytesRemoved](CleanupStats.md#bytesremoved)
- [oldVersions](CleanupStats.md#oldversions)
-
-## Properties
-
-### bytesRemoved
-
-• **bytesRemoved**: `number`
-
-The number of bytes removed from disk.
-
-#### Defined in
-
-[index.ts:637](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L637)
-
-___
-
-### oldVersions
-
-• **oldVersions**: `number`
-
-The number of old table versions removed.
-
-#### Defined in
-
-[index.ts:641](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L641)
--- a/docs/src/javascript/interfaces/CompactionMetrics.md
+++ b/docs/src/javascript/interfaces/CompactionMetrics.md
@@ -1,62 +0,0 @@
-[vectordb](../README.md) / [Exports](../modules.md) / CompactionMetrics
-
-# Interface: CompactionMetrics
-
-## Table of contents
-
-### Properties
-
- [filesAdded](CompactionMetrics.md#filesadded)
- [filesRemoved](CompactionMetrics.md#filesremoved)
- [fragmentsAdded](CompactionMetrics.md#fragmentsadded)
- [fragmentsRemoved](CompactionMetrics.md#fragmentsremoved)
-
-## Properties
-
-### filesAdded
-
-• **filesAdded**: `number`
-
-The number of files added. This is typically equal to the number of
-fragments added.
-
-#### Defined in
-
-[index.ts:692](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L692)
-
-___
-
-### filesRemoved
-
-• **filesRemoved**: `number`
-
-The number of files that were removed. Each fragment may have more than one
-file.
-
-#### Defined in
-
-[index.ts:687](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L687)
-
-___
-
-### fragmentsAdded
-
-• **fragmentsAdded**: `number`
-
-The number of new fragments that were created.
-
-#### Defined in
-
-[index.ts:682](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L682)
-
-___
-
-### fragmentsRemoved
-
-• **fragmentsRemoved**: `number`
-
-The number of fragments that were removed.
-
-#### Defined in
-
-[index.ts:678](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L678)
--- a/docs/src/javascript/interfaces/CompactionOptions.md
+++ b/docs/src/javascript/interfaces/CompactionOptions.md
@@ -1,80 +0,0 @@
-[vectordb](../README.md) / [Exports](../modules.md) / CompactionOptions
-
-# Interface: CompactionOptions
-
-## Table of contents
-
-### Properties
-
- [materializeDeletions](CompactionOptions.md#materializedeletions)
- [materializeDeletionsThreshold](CompactionOptions.md#materializedeletionsthreshold)
- [maxRowsPerGroup](CompactionOptions.md#maxrowspergroup)
- [numThreads](CompactionOptions.md#numthreads)
- [targetRowsPerFragment](CompactionOptions.md#targetrowsperfragment)
-
-## Properties
-
-### materializeDeletions
-
-• `Optional` **materializeDeletions**: `boolean`
-
-If true, fragments that have rows that are deleted may be compacted to
-remove the deleted rows. This can improve the performance of queries.
-Default is true.
-
-#### Defined in
-
-[index.ts:660](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L660)
-
-___
-
-### materializeDeletionsThreshold
-
-• `Optional` **materializeDeletionsThreshold**: `number`
-
-A number between 0 and 1, representing the proportion of rows that must be
-marked deleted before a fragment is a candidate for compaction to remove
-the deleted rows. Default is 10%.
-
-#### Defined in
-
-[index.ts:666](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L666)
-
-___
-
-### maxRowsPerGroup
-
-• `Optional` **maxRowsPerGroup**: `number`
-
-The maximum number of rows per group. Defaults to 1024.
-
-#### Defined in
-
-[index.ts:654](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L654)
-
-___
-
-### numThreads
-
-• `Optional` **numThreads**: `number`
-
-The number of threads to use for compaction. If not provided, defaults to
-the number of cores on the machine.
-
-#### Defined in
-
-[index.ts:671](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L671)
-
-___
-
-### targetRowsPerFragment
-
-• `Optional` **targetRowsPerFragment**: `number`
-
-The number of rows per fragment to target. Fragments that have fewer rows
-will be compacted into adjacent fragments to produce larger fragments.
-Defaults to 1024 * 1024.
-
-#### Defined in
-
-[index.ts:650](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L650)
--- a/docs/src/javascript/interfaces/Connection.md
+++ b/docs/src/javascript/interfaces/Connection.md
@@ -19,6 +19,7 @@ Connection could be local against filesystem or remote against a server.
 ### Methods

 - [createTable](Connection.md#createtable)
+- [createTableArrow](Connection.md#createtablearrow)
 - [dropTable](Connection.md#droptable)
 - [openTable](Connection.md#opentable)
 - [tableNames](Connection.md#tablenames)
@@ -31,15 +32,15 @@ Connection could be local against filesystem or remote against a server.

 #### Defined in

-[index.ts:125](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L125)
+[index.ts:70](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L70)

 ## Methods

 ### createTable

-▸ **createTable**\<`T`\>(`«destructured»`): `Promise`\<[`Table`](Table.md)\<`T`\>\>
+▸ **createTable**<`T`\>(`name`, `data`, `mode?`, `embeddings?`): `Promise`<[`Table`](Table.md)<`T`\>\>

-Creates a new Table, optionally initializing it with new data.
+Creates a new Table and initialize it with new data.

 #### Type parameters

@@ -49,115 +50,47 @@ Creates a new Table, optionally initializing it with new data.

 #### Parameters

+| Name | Type | Description |
+| :------ | :------ | :------ |
+| `name` | `string` | The name of the table. |
+| `data` | `Record`<`string`, `unknown`\>[] | Non-empty Array of Records to be inserted into the table |
+| `mode?` | [`WriteMode`](../enums/WriteMode.md) | The write mode to use when creating the table. |
+| `embeddings?` | [`EmbeddingFunction`](EmbeddingFunction.md)<`T`\> | An embedding function to use on this table |
+
+#### Returns
+
+`Promise`<[`Table`](Table.md)<`T`\>\>
+
+#### Defined in
+
+[index.ts:90](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L90)
+
+___
+
+### createTableArrow
+
+▸ **createTableArrow**(`name`, `table`): `Promise`<[`Table`](Table.md)<`number`[]\>\>
+
+#### Parameters
+
 | Name | Type |
 | :------ | :------ |
-| `«destructured»` | [`CreateTableOptions`](CreateTableOptions.md)\<`T`\> |
+| `name` | `string` |
+| `table` | `Table`<`any`\> |

 #### Returns

-`Promise`\<[`Table`](Table.md)\<`T`\>\>
+`Promise`<[`Table`](Table.md)<`number`[]\>\>

 #### Defined in

-[index.ts:146](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L146)
-
-▸ **createTable**(`name`, `data`): `Promise`\<[`Table`](Table.md)\<`number`[]\>\>
-
-Creates a new Table and initialize it with new data.
-
-#### Parameters
-
-| Name | Type | Description |
-| :------ | :------ | :------ |
-| `name` | `string` | The name of the table. |
-| `data` | `Record`\<`string`, `unknown`\>[] | Non-empty Array of Records to be inserted into the table |
-
-#### Returns
-
-`Promise`\<[`Table`](Table.md)\<`number`[]\>\>
-
-#### Defined in
-
-[index.ts:154](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L154)
-
-▸ **createTable**(`name`, `data`, `options`): `Promise`\<[`Table`](Table.md)\<`number`[]\>\>
-
-Creates a new Table and initialize it with new data.
-
-#### Parameters
-
-| Name | Type | Description |
-| :------ | :------ | :------ |
-| `name` | `string` | The name of the table. |
-| `data` | `Record`\<`string`, `unknown`\>[] | Non-empty Array of Records to be inserted into the table |
-| `options` | [`WriteOptions`](WriteOptions.md) | The write options to use when creating the table. |
-
-#### Returns
-
-`Promise`\<[`Table`](Table.md)\<`number`[]\>\>
-
-#### Defined in
-
-[index.ts:163](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L163)
-
-▸ **createTable**\<`T`\>(`name`, `data`, `embeddings`): `Promise`\<[`Table`](Table.md)\<`T`\>\>
-
-Creates a new Table and initialize it with new data.
-
-#### Type parameters
-
-| Name |
-| :------ |
-| `T` |
-
-#### Parameters
-
-| Name | Type | Description |
-| :------ | :------ | :------ |
-| `name` | `string` | The name of the table. |
-| `data` | `Record`\<`string`, `unknown`\>[] | Non-empty Array of Records to be inserted into the table |
-| `embeddings` | [`EmbeddingFunction`](EmbeddingFunction.md)\<`T`\> | An embedding function to use on this table |
-
-#### Returns
-
-`Promise`\<[`Table`](Table.md)\<`T`\>\>
-
-#### Defined in
-
-[index.ts:172](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L172)
-
-▸ **createTable**\<`T`\>(`name`, `data`, `embeddings`, `options`): `Promise`\<[`Table`](Table.md)\<`T`\>\>
-
-Creates a new Table and initialize it with new data.
-
-#### Type parameters
-
-| Name |
-| :------ |
-| `T` |
-
-#### Parameters
-
-| Name | Type | Description |
-| :------ | :------ | :------ |
-| `name` | `string` | The name of the table. |
-| `data` | `Record`\<`string`, `unknown`\>[] | Non-empty Array of Records to be inserted into the table |
-| `embeddings` | [`EmbeddingFunction`](EmbeddingFunction.md)\<`T`\> | An embedding function to use on this table |
-| `options` | [`WriteOptions`](WriteOptions.md) | The write options to use when creating the table. |
-
-#### Returns
-
-`Promise`\<[`Table`](Table.md)\<`T`\>\>
-
-#### Defined in
-
-[index.ts:181](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L181)
+[index.ts:92](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L92)

 ___

 ### dropTable

-▸ **dropTable**(`name`): `Promise`\<`void`\>
+▸ **dropTable**(`name`): `Promise`<`void`\>

 Drop an existing table.

@@ -169,17 +102,17 @@ Drop an existing table.

 #### Returns

-`Promise`\<`void`\>
+`Promise`<`void`\>

 #### Defined in

-[index.ts:187](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L187)
+[index.ts:98](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L98)

 ___

 ### openTable

-▸ **openTable**\<`T`\>(`name`, `embeddings?`): `Promise`\<[`Table`](Table.md)\<`T`\>\>
+▸ **openTable**<`T`\>(`name`, `embeddings?`): `Promise`<[`Table`](Table.md)<`T`\>\>

 Open a table in the database.

@@ -194,26 +127,26 @@ Open a table in the database.
 | Name | Type | Description |
 | :------ | :------ | :------ |
 | `name` | `string` | The name of the table. |
-| `embeddings?` | [`EmbeddingFunction`](EmbeddingFunction.md)\<`T`\> | An embedding function to use on this table |
+| `embeddings?` | [`EmbeddingFunction`](EmbeddingFunction.md)<`T`\> | An embedding function to use on this table |

 #### Returns

-`Promise`\<[`Table`](Table.md)\<`T`\>\>
+`Promise`<[`Table`](Table.md)<`T`\>\>

 #### Defined in

-[index.ts:135](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L135)
+[index.ts:80](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L80)

 ___

 ### tableNames

-▸ **tableNames**(): `Promise`\<`string`[]\>
+▸ **tableNames**(): `Promise`<`string`[]\>

 #### Returns

-`Promise`\<`string`[]\>
+`Promise`<`string`[]\>

 #### Defined in

-[index.ts:127](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L127)
+[index.ts:72](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L72)
--- a/docs/src/javascript/interfaces/ConnectionOptions.md
+++ b/docs/src/javascript/interfaces/ConnectionOptions.md
@@ -6,62 +6,18 @@

 ### Properties

- [apiKey](ConnectionOptions.md#apikey)
 - [awsCredentials](ConnectionOptions.md#awscredentials)
- [awsRegion](ConnectionOptions.md#awsregion)
- [hostOverride](ConnectionOptions.md#hostoverride)
- [region](ConnectionOptions.md#region)
 - [uri](ConnectionOptions.md#uri)

 ## Properties

-### apiKey
-
-• `Optional` **apiKey**: `string`
-
-#### Defined in
-
-[index.ts:49](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L49)
-
-___
-
 ### awsCredentials

 • `Optional` **awsCredentials**: [`AwsCredentials`](AwsCredentials.md)

 #### Defined in

-[index.ts:44](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L44)
-
-___
-
-### awsRegion
-
-• `Optional` **awsRegion**: `string`
-
-#### Defined in
-
-[index.ts:46](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L46)
-
-___
-
-### hostOverride
-
-• `Optional` **hostOverride**: `string`
-
-#### Defined in
-
-[index.ts:54](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L54)
-
-___
-
-### region
-
-• `Optional` **region**: `string`
-
-#### Defined in
-
-[index.ts:51](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L51)
+[index.ts:40](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L40)

 ___

@@ -71,4 +27,4 @@ ___

 #### Defined in

-[index.ts:42](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L42)
+[index.ts:39](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L39)
--- a/docs/src/javascript/interfaces/CreateTableOptions.md
+++ b/docs/src/javascript/interfaces/CreateTableOptions.md
@@ -1,69 +0,0 @@
-[vectordb](../README.md) / [Exports](../modules.md) / CreateTableOptions
-
-# Interface: CreateTableOptions\<T\>
-
-## Type parameters
-
-| Name |
-| :------ |
-| `T` |
-
-## Table of contents
-
-### Properties
-
- [data](CreateTableOptions.md#data)
- [embeddingFunction](CreateTableOptions.md#embeddingfunction)
- [name](CreateTableOptions.md#name)
- [schema](CreateTableOptions.md#schema)
- [writeOptions](CreateTableOptions.md#writeoptions)
-
-## Properties
-
-### data
-
-• `Optional` **data**: `Table`\<`any`\> \| `Record`\<`string`, `unknown`\>[]
-
-#### Defined in
-
-[index.ts:79](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L79)
-
-___
-
-### embeddingFunction
-
-• `Optional` **embeddingFunction**: [`EmbeddingFunction`](EmbeddingFunction.md)\<`T`\>
-
-#### Defined in
-
-[index.ts:85](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L85)
-
-___
-
-### name
-
-• **name**: `string`
-
-#### Defined in
-
-[index.ts:76](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L76)
-
-___
-
-### schema
-
-• `Optional` **schema**: `Schema`\<`any`\>
-
-#### Defined in
-
-[index.ts:82](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L82)
-
-___
-
-### writeOptions
-
-• `Optional` **writeOptions**: [`WriteOptions`](WriteOptions.md)
-
-#### Defined in
-
-[index.ts:88](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L88)
--- a/docs/src/javascript/interfaces/EmbeddingFunction.md
+++ b/docs/src/javascript/interfaces/EmbeddingFunction.md
@@ -1,6 +1,6 @@
 [vectordb](../README.md) / [Exports](../modules.md) / EmbeddingFunction

-# Interface: EmbeddingFunction\<T\>
+# Interface: EmbeddingFunction<T\>

 An embedding function that automatically creates vector representation for a given column.

@@ -25,11 +25,11 @@ An embedding function that automatically creates vector representation for a giv

 ### embed

-• **embed**: (`data`: `T`[]) => `Promise`\<`number`[][]\>
+• **embed**: (`data`: `T`[]) => `Promise`<`number`[][]\>

 #### Type declaration

-▸ (`data`): `Promise`\<`number`[][]\>
+▸ (`data`): `Promise`<`number`[][]\>

 Creates a vector representation for the given values.

@@ -41,11 +41,11 @@ Creates a vector representation for the given values.

 ##### Returns

-`Promise`\<`number`[][]\>
+`Promise`<`number`[][]\>

 #### Defined in

-[embedding/embedding_function.ts:27](https://github.com/lancedb/lancedb/blob/7856a94/node/src/embedding/embedding_function.ts#L27)
+[embedding/embedding_function.ts:27](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/embedding/embedding_function.ts#L27)

 ___

@@ -57,4 +57,4 @@ The name of the column that will be used as input for the Embedding Function.

 #### Defined in

-[embedding/embedding_function.ts:22](https://github.com/lancedb/lancedb/blob/7856a94/node/src/embedding/embedding_function.ts#L22)
+[embedding/embedding_function.ts:22](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/embedding/embedding_function.ts#L22)
--- a/docs/src/javascript/interfaces/IndexStats.md
+++ b/docs/src/javascript/interfaces/IndexStats.md
@@ -1,30 +0,0 @@
-[vectordb](../README.md) / [Exports](../modules.md) / IndexStats
-
-# Interface: IndexStats
-
-## Table of contents
-
-### Properties
-
- [numIndexedRows](IndexStats.md#numindexedrows)
- [numUnindexedRows](IndexStats.md#numunindexedrows)
-
-## Properties
-
-### numIndexedRows
-
-• **numIndexedRows**: ``null`` \| `number`
-
-#### Defined in
-
-[index.ts:344](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L344)
-
-___
-
-### numUnindexedRows
-
-• **numUnindexedRows**: ``null`` \| `number`
-
-#### Defined in
-
-[index.ts:345](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L345)
--- a/docs/src/javascript/interfaces/IvfPQIndexConfig.md
+++ b/docs/src/javascript/interfaces/IvfPQIndexConfig.md
@@ -7,7 +7,6 @@
 ### Properties

 - [column](IvfPQIndexConfig.md#column)
- [index\_cache\_size](IvfPQIndexConfig.md#index_cache_size)
 - [index\_name](IvfPQIndexConfig.md#index_name)
 - [max\_iters](IvfPQIndexConfig.md#max_iters)
 - [max\_opq\_iters](IvfPQIndexConfig.md#max_opq_iters)
@@ -29,19 +28,7 @@ The column to be indexed

 #### Defined in

-[index.ts:701](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L701)
-
-___
-
-### index\_cache\_size
-
-• `Optional` **index\_cache\_size**: `number`
-
-Cache size of the index
-
-#### Defined in
-
-[index.ts:750](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L750)
+[index.ts:382](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L382)

 ___

@@ -53,7 +40,7 @@ A unique name for the index

 #### Defined in

-[index.ts:706](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L706)
+[index.ts:387](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L387)

 ___

@@ -65,7 +52,7 @@ The max number of iterations for kmeans training.

 #### Defined in

-[index.ts:721](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L721)
+[index.ts:402](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L402)

 ___

@@ -77,7 +64,7 @@ Max number of iterations to train OPQ, if `use_opq` is true.

 #### Defined in

-[index.ts:740](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L740)
+[index.ts:421](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L421)

 ___

@@ -89,7 +76,7 @@ Metric type, L2 or Cosine

 #### Defined in

-[index.ts:711](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L711)
+[index.ts:392](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L392)

 ___

@@ -101,7 +88,7 @@ The number of bits to present one PQ centroid.

 #### Defined in

-[index.ts:735](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L735)
+[index.ts:416](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L416)

 ___

@@ -113,7 +100,7 @@ The number of partitions this index

 #### Defined in

-[index.ts:716](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L716)
+[index.ts:397](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L397)

 ___

@@ -125,7 +112,7 @@ Number of subvectors to build PQ code

 #### Defined in

-[index.ts:731](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L731)
+[index.ts:412](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L412)

 ___

@@ -137,7 +124,7 @@ Replace an existing index with the same name if it exists.

 #### Defined in

-[index.ts:745](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L745)
+[index.ts:426](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L426)

 ___

@@ -147,7 +134,7 @@ ___

 #### Defined in

-[index.ts:752](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L752)
+[index.ts:428](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L428)

 ___

@@ -159,4 +146,4 @@ Train as optimized product quantization.

 #### Defined in

-[index.ts:726](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L726)
+[index.ts:407](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L407)
--- a/docs/src/javascript/interfaces/Table.md
+++ b/docs/src/javascript/interfaces/Table.md
@@ -1,6 +1,6 @@
 [vectordb](../README.md) / [Exports](../modules.md) / Table

-# Interface: Table\<T\>
+# Interface: Table<T\>

 A LanceDB Table is the collection of Records. Each Record has one or more vector fields.

@@ -22,22 +22,19 @@ A LanceDB Table is the collection of Records. Each Record has one or more vector
 - [countRows](Table.md#countrows)
 - [createIndex](Table.md#createindex)
 - [delete](Table.md#delete)
- [indexStats](Table.md#indexstats)
- [listIndices](Table.md#listindices)
 - [name](Table.md#name)
 - [overwrite](Table.md#overwrite)
 - [search](Table.md#search)
- [update](Table.md#update)

 ## Properties

 ### add

-• **add**: (`data`: `Record`\<`string`, `unknown`\>[]) => `Promise`\<`number`\>
+• **add**: (`data`: `Record`<`string`, `unknown`\>[]) => `Promise`<`number`\>

 #### Type declaration

-▸ (`data`): `Promise`\<`number`\>
+▸ (`data`): `Promise`<`number`\>

 Insert records into this Table.

@@ -45,50 +42,54 @@ Insert records into this Table.

 | Name | Type | Description |
 | :------ | :------ | :------ |
-| `data` | `Record`\<`string`, `unknown`\>[] | Records to be inserted into the Table |
+| `data` | `Record`<`string`, `unknown`\>[] | Records to be inserted into the Table |

 ##### Returns

-`Promise`\<`number`\>
+`Promise`<`number`\>

 The number of rows added to the table

 #### Defined in

-[index.ts:209](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L209)
+[index.ts:120](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L120)

 ___

 ### countRows

-• **countRows**: () => `Promise`\<`number`\>
+• **countRows**: () => `Promise`<`number`\>

 #### Type declaration

-▸ (): `Promise`\<`number`\>
+▸ (): `Promise`<`number`\>

 Returns the number of rows in this table.

 ##### Returns

-`Promise`\<`number`\>
+`Promise`<`number`\>

 #### Defined in

-[index.ts:229](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L229)
+[index.ts:140](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L140)

 ___

 ### createIndex

-• **createIndex**: (`indexParams`: [`IvfPQIndexConfig`](IvfPQIndexConfig.md)) => `Promise`\<`any`\>
+• **createIndex**: (`indexParams`: [`IvfPQIndexConfig`](IvfPQIndexConfig.md)) => `Promise`<`any`\>

 #### Type declaration

-▸ (`indexParams`): `Promise`\<`any`\>
+▸ (`indexParams`): `Promise`<`any`\>

 Create an ANN index on this Table vector index.

+**`See`**
+
+VectorIndexParams.
+
 ##### Parameters

 | Name | Type | Description |
@@ -97,41 +98,27 @@ Create an ANN index on this Table vector index.

 ##### Returns

-`Promise`\<`any`\>
-
-**`See`**
-
-VectorIndexParams.
+`Promise`<`any`\>

 #### Defined in

-[index.ts:224](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L224)
+[index.ts:135](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L135)

 ___

 ### delete

-• **delete**: (`filter`: `string`) => `Promise`\<`void`\>
+• **delete**: (`filter`: `string`) => `Promise`<`void`\>

 #### Type declaration

-▸ (`filter`): `Promise`\<`void`\>
+▸ (`filter`): `Promise`<`void`\>

 Delete rows from this table.

 This can be used to delete a single row, many rows, all rows, or
 sometimes no rows (if your predicate matches nothing).

-##### Parameters
-
-| Name | Type | Description |
-| :------ | :------ | :------ |
-| `filter` | `string` | A filter in the same format used by a sql WHERE clause. The filter must not be empty. |
-
-##### Returns
-
-`Promise`\<`void`\>
-
 **`Examples`**

 ```ts
@@ -155,55 +142,19 @@ await tbl.delete(`id IN (${to_remove.join(",")})`)
 await tbl.countRows() // Returns 1
 ```

-#### Defined in
-
-[index.ts:263](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L263)
-
-___
-
-### indexStats
-
-• **indexStats**: (`indexUuid`: `string`) => `Promise`\<[`IndexStats`](IndexStats.md)\>
-
-#### Type declaration
-
-▸ (`indexUuid`): `Promise`\<[`IndexStats`](IndexStats.md)\>
-
-Get statistics about an index.
-
 ##### Parameters

-| Name | Type |
-| :------ | :------ |
-| `indexUuid` | `string` |
+| Name | Type | Description |
+| :------ | :------ | :------ |
+| `filter` | `string` | A filter in the same format used by a sql WHERE clause. The filter must not be empty. |

 ##### Returns

-`Promise`\<[`IndexStats`](IndexStats.md)\>
+`Promise`<`void`\>

 #### Defined in

-[index.ts:306](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L306)
-
-___
-
-### listIndices
-
-• **listIndices**: () => `Promise`\<[`VectorIndex`](VectorIndex.md)[]\>
-
-#### Type declaration
-
-▸ (): `Promise`\<[`VectorIndex`](VectorIndex.md)[]\>
-
-List the indicies on this table.
-
-##### Returns
-
-`Promise`\<[`VectorIndex`](VectorIndex.md)[]\>
-
-#### Defined in
-
-[index.ts:301](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L301)
+[index.ts:174](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L174)

 ___

@@ -213,17 +164,17 @@ ___

 #### Defined in

-[index.ts:195](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L195)
+[index.ts:106](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L106)

 ___

 ### overwrite

-• **overwrite**: (`data`: `Record`\<`string`, `unknown`\>[]) => `Promise`\<`number`\>
+• **overwrite**: (`data`: `Record`<`string`, `unknown`\>[]) => `Promise`<`number`\>

 #### Type declaration

-▸ (`data`): `Promise`\<`number`\>
+▸ (`data`): `Promise`<`number`\>

 Insert records into this Table, replacing its contents.

@@ -231,27 +182,27 @@ Insert records into this Table, replacing its contents.

 | Name | Type | Description |
 | :------ | :------ | :------ |
-| `data` | `Record`\<`string`, `unknown`\>[] | Records to be inserted into the Table |
+| `data` | `Record`<`string`, `unknown`\>[] | Records to be inserted into the Table |

 ##### Returns

-`Promise`\<`number`\>
+`Promise`<`number`\>

 The number of rows added to the table

 #### Defined in

-[index.ts:217](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L217)
+[index.ts:128](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L128)

 ___

 ### search

-• **search**: (`query`: `T`) => [`Query`](../classes/Query.md)\<`T`\>
+• **search**: (`query`: `T`) => [`Query`](../classes/Query.md)<`T`\>

 #### Type declaration

-▸ (`query`): [`Query`](../classes/Query.md)\<`T`\>
+▸ (`query`): [`Query`](../classes/Query.md)<`T`\>

 Creates a search query to find the nearest neighbors of the given search term

@@ -263,59 +214,8 @@ Creates a search query to find the nearest neighbors of the given search term

 ##### Returns

-[`Query`](../classes/Query.md)\<`T`\>
+[`Query`](../classes/Query.md)<`T`\>

 #### Defined in

-[index.ts:201](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L201)
-
-___
-
-### update
-
-• **update**: (`args`: [`UpdateArgs`](UpdateArgs.md) \| [`UpdateSqlArgs`](UpdateSqlArgs.md)) => `Promise`\<`void`\>
-
-#### Type declaration
-
-▸ (`args`): `Promise`\<`void`\>
-
-Update rows in this table.
-
-This can be used to update a single row, many rows, all rows, or
-sometimes no rows (if your predicate matches nothing).
-
-##### Parameters
-
-| Name | Type | Description |
-| :------ | :------ | :------ |
-| `args` | [`UpdateArgs`](UpdateArgs.md) \| [`UpdateSqlArgs`](UpdateSqlArgs.md) | see [UpdateArgs](UpdateArgs.md) and [UpdateSqlArgs](UpdateSqlArgs.md) for more details |
-
-##### Returns
-
-`Promise`\<`void`\>
-
-**`Examples`**
-
-```ts
-const con = await lancedb.connect("./.lancedb")
-const data = [
-   {id: 1, vector: [3, 3], name: 'Ye'},
-   {id: 2, vector: [4, 4], name: 'Mike'},
-];
-const tbl = await con.createTable("my_table", data)
-
-await tbl.update({
-  filter: "id = 2",
-  updates: { vector: [2, 2], name: "Michael" },
-})
-
-let results = await tbl.search([1, 1]).execute();
-// Returns [
-//   {id: 2, vector: [2, 2], name: 'Michael'}
-//   {id: 1, vector: [3, 3], name: 'Ye'}
-// ]
-```
-
-#### Defined in
-
-[index.ts:296](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L296)
+[index.ts:112](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L112)
--- a/docs/src/javascript/interfaces/UpdateArgs.md
+++ b/docs/src/javascript/interfaces/UpdateArgs.md
@@ -1,36 +0,0 @@
-[vectordb](../README.md) / [Exports](../modules.md) / UpdateArgs
-
-# Interface: UpdateArgs
-
-## Table of contents
-
-### Properties
-
- [values](UpdateArgs.md#values)
- [where](UpdateArgs.md#where)
-
-## Properties
-
-### values
-
-• **values**: `Record`\<`string`, `Literal`\>
-
-A key-value map of updates. The keys are the column names, and the values are the
-new values to set
-
-#### Defined in
-
-[index.ts:320](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L320)
-
-___
-
-### where
-
-• `Optional` **where**: `string`
-
-A filter in the same format used by a sql WHERE clause. The filter may be empty,
-in which case all rows will be updated.
-
-#### Defined in
-
-[index.ts:314](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L314)
--- a/docs/src/javascript/interfaces/UpdateSqlArgs.md
+++ b/docs/src/javascript/interfaces/UpdateSqlArgs.md
@@ -1,36 +0,0 @@
-[vectordb](../README.md) / [Exports](../modules.md) / UpdateSqlArgs
-
-# Interface: UpdateSqlArgs
-
-## Table of contents
-
-### Properties
-
- [valuesSql](UpdateSqlArgs.md#valuessql)
- [where](UpdateSqlArgs.md#where)
-
-## Properties
-
-### valuesSql
-
-• **valuesSql**: `Record`\<`string`, `string`\>
-
-A key-value map of updates. The keys are the column names, and the values are the
-new values to set as SQL expressions.
-
-#### Defined in
-
-[index.ts:334](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L334)
-
-___
-
-### where
-
-• `Optional` **where**: `string`
-
-A filter in the same format used by a sql WHERE clause. The filter may be empty,
-in which case all rows will be updated.
-
-#### Defined in
-
-[index.ts:328](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L328)
--- a/docs/src/javascript/interfaces/VectorIndex.md
+++ b/docs/src/javascript/interfaces/VectorIndex.md
@@ -1,41 +0,0 @@
-[vectordb](../README.md) / [Exports](../modules.md) / VectorIndex
-
-# Interface: VectorIndex
-
-## Table of contents
-
-### Properties
-
- [columns](VectorIndex.md#columns)
- [name](VectorIndex.md#name)
- [uuid](VectorIndex.md#uuid)
-
-## Properties
-
-### columns
-
-• **columns**: `string`[]
-
-#### Defined in
-
-[index.ts:338](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L338)
-
-___
-
-### name
-
-• **name**: `string`
-
-#### Defined in
-
-[index.ts:339](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L339)
-
-___
-
-### uuid
-
-• **uuid**: `string`
-
-#### Defined in
-
-[index.ts:340](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L340)
--- a/docs/src/javascript/interfaces/WriteOptions.md
+++ b/docs/src/javascript/interfaces/WriteOptions.md
@@ -1,27 +0,0 @@
-[vectordb](../README.md) / [Exports](../modules.md) / WriteOptions
-
-# Interface: WriteOptions
-
-Write options when creating a Table.
-
-## Implemented by
-
- [`DefaultWriteOptions`](../classes/DefaultWriteOptions.md)
-
-## Table of contents
-
-### Properties
-
- [writeMode](WriteOptions.md#writemode)
-
-## Properties
-
-### writeMode
-
-• `Optional` **writeMode**: [`WriteMode`](../enums/WriteMode.md)
-
-A [WriteMode](../enums/WriteMode.md) to use on this operation
-
-#### Defined in
-
-[index.ts:774](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L774)
--- a/docs/src/javascript/modules.md
+++ b/docs/src/javascript/modules.md
@@ -11,7 +11,6 @@

 ### Classes

- [DefaultWriteOptions](classes/DefaultWriteOptions.md)
 - [LocalConnection](classes/LocalConnection.md)
 - [LocalTable](classes/LocalTable.md)
 - [OpenAIEmbeddingFunction](classes/OpenAIEmbeddingFunction.md)
@@ -20,20 +19,11 @@
 ### Interfaces

 - [AwsCredentials](interfaces/AwsCredentials.md)
- [CleanupStats](interfaces/CleanupStats.md)
- [CompactionMetrics](interfaces/CompactionMetrics.md)
- [CompactionOptions](interfaces/CompactionOptions.md)
 - [Connection](interfaces/Connection.md)
 - [ConnectionOptions](interfaces/ConnectionOptions.md)
- [CreateTableOptions](interfaces/CreateTableOptions.md)
 - [EmbeddingFunction](interfaces/EmbeddingFunction.md)
- [IndexStats](interfaces/IndexStats.md)
 - [IvfPQIndexConfig](interfaces/IvfPQIndexConfig.md)
 - [Table](interfaces/Table.md)
- [UpdateArgs](interfaces/UpdateArgs.md)
- [UpdateSqlArgs](interfaces/UpdateSqlArgs.md)
- [VectorIndex](interfaces/VectorIndex.md)
- [WriteOptions](interfaces/WriteOptions.md)

 ### Type Aliases

@@ -42,7 +32,6 @@
 ### Functions

 - [connect](modules.md#connect)
- [isWriteOptions](modules.md#iswriteoptions)

 ## Type Aliases

@@ -52,13 +41,13 @@

 #### Defined in

-[index.ts:755](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L755)
+[index.ts:431](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L431)

 ## Functions

 ### connect

-▸ **connect**(`uri`): `Promise`\<[`Connection`](interfaces/Connection.md)\>
+▸ **connect**(`uri`): `Promise`<[`Connection`](interfaces/Connection.md)\>

 Connect to a LanceDB instance at the given URI

@@ -70,44 +59,24 @@ Connect to a LanceDB instance at the given URI

 #### Returns

-`Promise`\<[`Connection`](interfaces/Connection.md)\>
+`Promise`<[`Connection`](interfaces/Connection.md)\>

 #### Defined in

-[index.ts:95](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L95)
+[index.ts:47](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L47)

-▸ **connect**(`opts`): `Promise`\<[`Connection`](interfaces/Connection.md)\>
+▸ **connect**(`opts`): `Promise`<[`Connection`](interfaces/Connection.md)\>

 #### Parameters

 | Name | Type |
 | :------ | :------ |
-| `opts` | `Partial`\<[`ConnectionOptions`](interfaces/ConnectionOptions.md)\> |
+| `opts` | `Partial`<[`ConnectionOptions`](interfaces/ConnectionOptions.md)\> |

 #### Returns

-`Promise`\<[`Connection`](interfaces/Connection.md)\>
+`Promise`<[`Connection`](interfaces/Connection.md)\>

 #### Defined in

-[index.ts:96](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L96)
-
-___
-
-### isWriteOptions
-
-▸ **isWriteOptions**(`value`): value is WriteOptions
-
-#### Parameters
-
-| Name | Type |
-| :------ | :------ |
-| `value` | `any` |
-
-#### Returns
-
-value is WriteOptions
-
-#### Defined in
-
-[index.ts:781](https://github.com/lancedb/lancedb/blob/7856a94/node/src/index.ts#L781)
+[index.ts:48](https://github.com/lancedb/lancedb/blob/b1eeb90/node/src/index.ts#L48)
--- a/docs/src/sql.md
+++ b/docs/src/sql.md
@@ -1,7 +1,7 @@
 # SQL filters

 LanceDB embraces the utilization of standard SQL expressions as predicates for hybrid
-filters. It can be used during hybrid vector search, update, and deletion operations.
+filters. It can be used during hybrid vector search and deletion operations.

 Currently, Lance supports a growing list of expressions.

--- a/node/README.md
+++ b/node/README.md
@@ -9,13 +9,8 @@ npm install vectordb
 ```

 This will download the appropriate native library for your platform. We currently
-support:
-
-* Linux (x86_64 and aarch64)
-* MacOS (Intel and ARM/M1/M2)
-* Windows (x86_64 only)
-
-We do not yet support musl-based Linux (such as Alpine Linux) or aarch64 Windows.
+support x86_64 Linux, aarch64 Linux, Intel MacOS, and ARM (M1/M2) MacOS. We do not
+yet support musl-based Linux (such as Alpine Linux).

 ## Usage

--- a/node/package.json
+++ b/node/package.json
@@ -1,6 +1,6 @@
 {
  "name": "vectordb",
-  "version": "0.4.1",
+  "version": "0.4.0",
  "description": " Serverless, low-latency vector database for AI applications",
  "main": "dist/index.js",
  "types": "dist/index.d.ts",
@@ -81,10 +81,10 @@
    }
  },
  "optionalDependencies": {
-    "@lancedb/vectordb-darwin-arm64": "0.4.1",
-    "@lancedb/vectordb-darwin-x64": "0.4.1",
-    "@lancedb/vectordb-linux-arm64-gnu": "0.4.1",
-    "@lancedb/vectordb-linux-x64-gnu": "0.4.1",
-    "@lancedb/vectordb-win32-x64-msvc": "0.4.1"
+    "@lancedb/vectordb-darwin-arm64": "0.4.0",
+    "@lancedb/vectordb-darwin-x64": "0.4.0",
+    "@lancedb/vectordb-linux-arm64-gnu": "0.4.0",
+    "@lancedb/vectordb-linux-x64-gnu": "0.4.0",
+    "@lancedb/vectordb-win32-x64-msvc": "0.4.0"
  }
 }
--- a/node/src/index.ts
+++ b/node/src/index.ts
@@ -24,7 +24,7 @@ import { isEmbeddingFunction } from './embedding/embedding_function'
 import { type Literal, toSQL } from './util'

 // eslint-disable-next-line @typescript-eslint/no-var-requires
-const { databaseNew, databaseTableNames, databaseOpenTable, databaseDropTable, tableCreate, tableAdd, tableCreateScalarIndex, tableCreateVectorIndex, tableCountRows, tableDelete, tableUpdate, tableCleanupOldVersions, tableCompactFiles, tableListIndices, tableIndexStats } = require('../native.js')
+const { databaseNew, databaseTableNames, databaseOpenTable, databaseDropTable, tableCreate, tableAdd, tableCreateVectorIndex, tableCountRows, tableDelete, tableUpdate, tableCleanupOldVersions, tableCompactFiles, tableListIndices, tableIndexStats } = require('../native.js')

 export { Query }
 export type { EmbeddingFunction }
@@ -223,56 +223,6 @@ export interface Table<T = number[]> {
   */
  createIndex: (indexParams: VectorIndexParams) => Promise<any>

-  /**
-   * Create a scalar index on this Table for the given column
-   *
-   * @param column The column to index
-   * @param replace If false, fail if an index already exists on the column
-   *
-   * Scalar indices, like vector indices, can be used to speed up scans.  A scalar
-   * index can speed up scans that contain filter expressions on the indexed column.
-   * For example, the following scan will be faster if the column `my_col` has
-   * a scalar index:
-   *
-   * ```ts
-   * const con = await lancedb.connect('./.lancedb');
-   * const table = await con.openTable('images');
-   * const results = await table.where('my_col = 7').execute();
-   * ```
-   *
-   * Scalar indices can also speed up scans containing a vector search and a
-   * prefilter:
-   *
-   * ```ts
-   * const con = await lancedb.connect('././lancedb');
-   * const table = await con.openTable('images');
-   * const results = await table.search([1.0, 2.0]).where('my_col != 7').prefilter(true);
-   * ```
-   *
-   * Scalar indices can only speed up scans for basic filters using
-   * equality, comparison, range (e.g. `my_col BETWEEN 0 AND 100`), and set
-   * membership (e.g. `my_col IN (0, 1, 2)`)
-   *
-   * Scalar indices can be used if the filter contains multiple indexed columns and
-   * the filter criteria are AND'd or OR'd together
-   * (e.g. `my_col < 0 AND other_col> 100`)
-   *
-   * Scalar indices may be used if the filter contains non-indexed columns but,
-   * depending on the structure of the filter, they may not be usable.  For example,
-   * if the column `not_indexed` does not have a scalar index then the filter
-   * `my_col = 0 OR not_indexed = 1` will not be able to use any scalar index on
-   * `my_col`.
-   *
-   * @examples
-   *
-   * ```ts
-   * const con = await lancedb.connect('././lancedb')
-   * const table = await con.openTable('images')
-   * await table.createScalarIndex('my_col')
-   * ```
-   */
-  createScalarIndex: (column: string, replace: boolean) => Promise<void>
-
  /**
   * Returns the number of rows in this table.
   */
@@ -331,8 +281,8 @@ export interface Table<T = number[]> {
   * const tbl = await con.createTable("my_table", data)
   *
   * await tbl.update({
-   *   where: "id = 2",
-   *   values: { vector: [2, 2], name: "Michael" },
+   *   filter: "id = 2",
+   *   updates: { vector: [2, 2], name: "Michael" },
   * })
   *
   * let results = await tbl.search([1, 1]).execute();
@@ -587,10 +537,6 @@ export class LocalTable<T = number[]> implements Table<T> {
    return tableCreateVectorIndex.call(this._tbl, indexParams).then((newTable: any) => { this._tbl = newTable })
  }

-  async createScalarIndex (column: string, replace: boolean): Promise<void> {
-    return tableCreateScalarIndex.call(this._tbl, column, replace)
-  }
-
  /**
   * Returns the number of rows in this table.
   */
--- a/node/src/remote/index.ts
+++ b/node/src/remote/index.ts
@@ -283,10 +283,6 @@ export class RemoteTable<T = number[]> implements Table<T> {
    }
  }

-  async createScalarIndex (column: string, replace: boolean): Promise<void> {
-    throw new Error('Not implemented')
-  }
-
  async countRows (): Promise<number> {
    const result = await this._client.post(`/v1/table/${this._name}/describe/`)
    return result.data?.stats?.num_rows
--- a/node/src/test/test.ts
+++ b/node/src/test/test.ts
@@ -135,17 +135,6 @@ describe('LanceDB client', function () {
      assert.isTrue(results.length === 10)
    })

-    it('should allow creation and use of scalar indices', async function () {
-      const uri = await createTestDB(16, 300)
-      const con = await lancedb.connect(uri)
-      const table = await con.openTable('vectors')
-      await table.createScalarIndex('id', true)
-
-      // Prefiltering should still work the same
-      const results = await table.search(new Array(16).fill(0.1)).limit(10).filter('id >= 10').prefilter(true).execute()
-      assert.isTrue(results.length === 10)
-    })
-
    it('select only a subset of columns', async function () {
      const uri = await createTestDB()
      const con = await lancedb.connect(uri)
--- a/python/.bumpversion.cfg
+++ b/python/.bumpversion.cfg
@@ -1,5 +1,5 @@
 [bumpversion]
-current_version = 0.4.1
+current_version = 0.4.0
 commit = True
 message = [python] Bump version: {current_version} → {new_version}
 tag = True
--- a/python/lancedb/remote/table.py
+++ b/python/lancedb/remote/table.py
@@ -64,12 +64,6 @@ class RemoteTable(Table):
        """to_pandas() is not supported on the LanceDB cloud"""
        return NotImplementedError("to_pandas() is not supported on the LanceDB cloud")

-    def create_scalar_index(self, *args, **kwargs):
-        """Creates a scalar index"""
-        return NotImplementedError(
-            "create_scalar_index() is not supported on the LanceDB cloud"
-        )
-
    def create_index(
        self,
        metric="L2",
--- a/python/lancedb/table.py
+++ b/python/lancedb/table.py
@@ -221,77 +221,6 @@ class Table(ABC):
        """
        raise NotImplementedError

-    @abstractmethod
-    def create_scalar_index(
-        self,
-        column: str,
-        *,
-        replace: bool = True,
-    ):
-        """Create a scalar index on a column.
-
-        Scalar indices, like vector indices, can be used to speed up scans.  A scalar
-        index can speed up scans that contain filter expressions on the indexed column.
-        For example, the following scan will be faster if the column ``my_col`` has
-        a scalar index:
-
-        .. code-block:: python
-
-            import lancedb
-
-            db = lancedb.connect("/data/lance")
-            img_table = db.open_table("images")
-            my_df = img_table.search().where("my_col = 7", prefilter=True).to_pandas()
-
-        Scalar indices can also speed up scans containing a vector search and a
-        prefilter:
-
-        .. code-block::python
-
-            import lancedb
-
-            db = lancedb.connect("/data/lance")
-            img_table = db.open_table("images")
-            img_table.search([1, 2, 3, 4], vector_column_name="vector")
-                .where("my_col != 7", prefilter=True)
-                .to_pandas()
-
-        Scalar indices can only speed up scans for basic filters using
-        equality, comparison, range (e.g. ``my_col BETWEEN 0 AND 100``), and set
-        membership (e.g. `my_col IN (0, 1, 2)`)
-
-        Scalar indices can be used if the filter contains multiple indexed columns and
-        the filter criteria are AND'd or OR'd together
-        (e.g. ``my_col < 0 AND other_col> 100``)
-
-        Scalar indices may be used if the filter contains non-indexed columns but,
-        depending on the structure of the filter, they may not be usable.  For example,
-        if the column ``not_indexed`` does not have a scalar index then the filter
-        ``my_col = 0 OR not_indexed = 1`` will not be able to use any scalar index on
-        ``my_col``.
-
-        **Experimental API**
-
-        Parameters
-        ----------
-        column : str
-            The column to be indexed.  Must be a boolean, integer, float,
-            or string column.
-        replace : bool, default True
-            Replace the existing index if it exists.
-
-        Examples
-        --------
-
-        .. code-block:: python
-
-            import lance
-
-            dataset = lance.dataset("/tmp/images.lance")
-            dataset.create_scalar_index("category")
-        """
-        raise NotImplementedError
-
    @abstractmethod
    def add(
        self,
@@ -455,62 +384,6 @@ class Table(ABC):
        """
        raise NotImplementedError

-    @abstractmethod
-    def update(
-        self,
-        where: Optional[str] = None,
-        values: Optional[dict] = None,
-        *,
-        values_sql: Optional[Dict[str, str]] = None,
-    ):
-        """
-        This can be used to update zero to all rows depending on how many
-        rows match the where clause. If no where clause is provided, then
-        all rows will be updated.
-
-        Either `values` or `values_sql` must be provided. You cannot provide
-        both.
-
-        Parameters
-        ----------
-        where: str, optional
-            The SQL where clause to use when updating rows. For example, 'x = 2'
-            or 'x IN (1, 2, 3)'. The filter must not be empty, or it will error.
-        values: dict, optional
-            The values to update. The keys are the column names and the values
-            are the values to set.
-        values_sql: dict, optional
-            The values to update, expressed as SQL expression strings. These can
-            reference existing columns. For example, {"x": "x + 1"} will increment
-            the x column by 1.
-
-        Examples
-        --------
-        >>> import lancedb
-        >>> import pandas as pd
-        >>> data = pd.DataFrame({"x": [1, 2, 3], "vector": [[1, 2], [3, 4], [5, 6]]})
-        >>> db = lancedb.connect("./.lancedb")
-        >>> table = db.create_table("my_table", data)
-        >>> table.to_pandas()
-           x      vector
-        0  1  [1.0, 2.0]
-        1  2  [3.0, 4.0]
-        2  3  [5.0, 6.0]
-        >>> table.update(where="x = 2", values={"vector": [10, 10]})
-        >>> table.to_pandas()
-           x        vector
-        0  1    [1.0, 2.0]
-        1  3    [5.0, 6.0]
-        2  2  [10.0, 10.0]
-        >>> table.update(values_sql={"x": "x + 1"})
-        >>> table.to_pandas()
-           x        vector
-        0  2    [1.0, 2.0]
-        1  4    [5.0, 6.0]
-        2  3  [10.0, 10.0]
-        """
-        raise NotImplementedError
-

 class LanceTable(Table):
    """
@@ -524,14 +397,6 @@ class LanceTable(Table):
        self.name = name
        self._version = version

-    def _reset_dataset(self, version=None):
-        try:
-            if "_dataset" in self.__dict__:
-                del self.__dict__["_dataset"]
-            self._version = version
-        except AttributeError:
-            pass
-
    @property
    def schema(self) -> pa.Schema:
        """Return the schema of the table.
@@ -540,16 +405,16 @@ class LanceTable(Table):
        -------
        pa.Schema
            A PyArrow schema object."""
-        return self._dataset.schema
+        return self.to_lance().schema

    def list_versions(self):
        """List all versions of the table"""
-        return self._dataset.versions()
+        return self.to_lance().versions()

    @property
    def version(self) -> int:
        """Get the current version of the table"""
-        return self._dataset.version
+        return self.to_lance().version

    def checkout(self, version: int):
        """Checkout a version of the table. This is an in-place operation.
@@ -582,14 +447,12 @@ class LanceTable(Table):
               vector    type
        0  [1.1, 0.9]  vector
        """
-        max_ver = max([v["version"] for v in self._dataset.versions()])
+        max_ver = max([v["version"] for v in self.to_lance().versions()])
        if version < 1 or version > max_ver:
            raise ValueError(f"Invalid version {version}")
-        self._reset_dataset(version=version)

        try:
-            # Accessing the property updates the cached value
-            _ = self._dataset
+            self.to_lance().checkout(version)
        except Exception as e:
            if "not found" in str(e):
                raise ValueError(
@@ -632,7 +495,7 @@ class LanceTable(Table):
        >>> len(table.list_versions())
        4
        """
-        max_ver = max([v["version"] for v in self._dataset.versions()])
+        max_ver = max([v["version"] for v in self.to_lance().versions()])
        if version is None:
            version = self.version
        elif version < 1 or version > max_ver:
@@ -644,11 +507,10 @@ class LanceTable(Table):
            # no-op if restoring the latest version
            return

-        self._dataset.restore()
-        self._reset_dataset()
+        self.to_lance().restore()

    def __len__(self):
-        return self._dataset.count_rows()
+        return self.to_lance().count_rows()

    def __repr__(self) -> str:
        return f"LanceTable({self.name})"
@@ -658,7 +520,7 @@ class LanceTable(Table):

    def head(self, n=5) -> pa.Table:
        """Return the first n rows of the table."""
-        return self._dataset.head(n)
+        return self.to_lance().head(n)

    def to_pandas(self) -> "pd.DataFrame":
        """Return the table as a pandas DataFrame.
@@ -675,7 +537,7 @@ class LanceTable(Table):
        Returns
        -------
        pa.Table"""
-        return self._dataset.to_table()
+        return self.to_lance().to_table()

    @property
    def _dataset_uri(self) -> str:
@@ -702,12 +564,8 @@ class LanceTable(Table):
            accelerator=accelerator,
            index_cache_size=index_cache_size,
        )
-        self._reset_dataset()
        register_event("create_index")

-    def create_scalar_index(self, column: str, *, replace: bool = True):
-        self._dataset.create_scalar_index(column, index_type="BTREE", replace=replace)
-
    def create_fts_index(
        self, field_names: Union[str, List[str]], *, replace: bool = False
    ):
@@ -737,7 +595,11 @@ class LanceTable(Table):
                raise ValueError(
                    f"Index already exists. Use replace=True to overwrite."
                )
-            fs.delete_dir(path)
+            try:
+                fs.delete_dir(path)
+            except FileNotFoundError as e:
+                if "Cannot get information for path" in str(e):
+                    pass

        index = create_index(self._get_fts_index_path(), field_names)
        populate_index(index, self, field_names)
@@ -792,8 +654,7 @@ class LanceTable(Table):
            on_bad_vectors=on_bad_vectors,
            fill_value=fill_value,
        )
-        lance.write_dataset(data, self._dataset_uri, schema=self.schema, mode=mode)
-        self._reset_dataset()
+        self.to_lance().write(data, mode=mode)
        register_event("add")

    def merge(
@@ -854,10 +715,9 @@ class LanceTable(Table):
            other_table = other_table.to_lance()
        if isinstance(other_table, LanceDataset):
            other_table = other_table.to_table()
-        self._dataset.merge(
+        self.to_lance().merge(
            other_table, left_on=left_on, right_on=right_on, schema=schema
        )
-        self._reset_dataset()
        register_event("merge")

    @cached_property
@@ -1060,7 +920,7 @@ class LanceTable(Table):
        return tbl

    def delete(self, where: str):
-        self._dataset.delete(where)
+        self.to_lance().delete(where)

    def update(
        self,
@@ -1115,7 +975,6 @@ class LanceTable(Table):
            values_sql = {k: value_to_sql(v) for k, v in values.items()}

        self.to_lance().update(values_sql, where)
-        self._reset_dataset()
        register_event("update")

    def _execute_query(self, query: Query) -> pa.Table:
--- a/python/pyproject.toml
+++ b/python/pyproject.toml
@@ -1,6 +1,6 @@
 [project]
 name = "lancedb"
-version = "0.4.1"
+version = "0.4.0"
 dependencies = [
    "deprecation",
    "pylance==0.9.1",
--- a/python/tests/test_fts.py
+++ b/python/tests/test_fts.py
@@ -95,12 +95,12 @@ def test_create_index_from_table(tmp_path, table):
        ]
    )

-    with pytest.raises(ValueError, match="already exists"):
-        table.create_fts_index("text")
-
    table.create_fts_index("text", replace=True)
    assert len(table.search("gorilla").limit(1).to_pandas()) == 1

+    with pytest.raises(ValueError, match="already exists"):
+        table.create_fts_index("text")
+

 def test_create_index_multiple_columns(tmp_path, table):
    table.create_fts_index(["text", "text2"])
--- a/python/tests/test_table.py
+++ b/python/tests/test_table.py
@@ -226,39 +226,38 @@ def test_versioning(db):


 def test_create_index_method():
-    with patch.object(LanceTable, "_reset_dataset", return_value=None):
-        with patch.object(
-            LanceTable, "_dataset", new_callable=PropertyMock
-        ) as mock_dataset:
-            # Setup mock responses
-            mock_dataset.return_value.create_index.return_value = None
+    with patch.object(
+        LanceTable, "_dataset", new_callable=PropertyMock
+    ) as mock_dataset:
+        # Setup mock responses
+        mock_dataset.return_value.create_index.return_value = None

-            # Create a LanceTable object
-            connection = LanceDBConnection(uri="mock.uri")
-            table = LanceTable(connection, "test_table")
+        # Create a LanceTable object
+        connection = LanceDBConnection(uri="mock.uri")
+        table = LanceTable(connection, "test_table")

-            # Call the create_index method
-            table.create_index(
-                metric="L2",
-                num_partitions=256,
-                num_sub_vectors=96,
-                vector_column_name="vector",
-                replace=True,
-                index_cache_size=256,
-            )
+        # Call the create_index method
+        table.create_index(
+            metric="L2",
+            num_partitions=256,
+            num_sub_vectors=96,
+            vector_column_name="vector",
+            replace=True,
+            index_cache_size=256,
+        )

-            # Check that the _dataset.create_index method was called
-            # with the right parameters
-            mock_dataset.return_value.create_index.assert_called_once_with(
-                column="vector",
-                index_type="IVF_PQ",
-                metric="L2",
-                num_partitions=256,
-                num_sub_vectors=96,
-                replace=True,
-                accelerator=None,
-                index_cache_size=256,
-            )
+        # Check that the _dataset.create_index method was called
+        # with the right parameters
+        mock_dataset.return_value.create_index.assert_called_once_with(
+            column="vector",
+            index_type="IVF_PQ",
+            metric="L2",
+            num_partitions=256,
+            num_sub_vectors=96,
+            replace=True,
+            accelerator=None,
+            index_cache_size=256,
+        )


 def test_add_with_nans(db):
@@ -532,33 +531,6 @@ def test_multiple_vector_columns(db):
    assert result1["text"].iloc[0] != result2["text"].iloc[0]


-def test_create_scalar_index(db):
-    vec_array = pa.array(
-        [[1, 1], [2, 2], [3, 3], [4, 4], [5, 5]], pa.list_(pa.float32(), 2)
-    )
-    test_data = pa.Table.from_pydict(
-        {"x": ["c", "b", "a", "e", "b"], "y": [1, 2, 3, 4, 5], "vector": vec_array}
-    )
-    table = LanceTable.create(
-        db,
-        "my_table",
-        data=test_data,
-    )
-    table.create_scalar_index("x")
-    indices = table.to_lance().list_indices()
-    assert len(indices) == 1
-    scalar_index = indices[0]
-    assert scalar_index["type"] == "Scalar"
-
-    # Confirm that prefiltering still works with the scalar index column
-    results = table.search().where("x = 'c'").to_arrow()
-    assert results == test_data.slice(0, 1)
-    results = table.search([5, 5]).to_arrow()
-    assert results["_distance"][0].as_py() == 0
-    results = table.search([5, 5]).where("x != 'b'").to_arrow()
-    assert results["_distance"][0].as_py() > 0
-
-
 def test_empty_query(db):
    table = LanceTable.create(
        db,
--- a/rust/ffi/node/Cargo.toml
+++ b/rust/ffi/node/Cargo.toml
@@ -1,6 +1,6 @@
 [package]
 name = "vectordb-node"
-version = "0.4.1"
+version = "0.4.0"
 description = "Serverless, low-latency vector database for AI applications"
 license = "Apache-2.0"
 edition = "2018"
--- a/rust/ffi/node/src/index.rs
+++ b/rust/ffi/node/src/index.rs
@@ -12,5 +12,4 @@
 // See the License for the specific language governing permissions and
 // limitations under the License.

-pub mod scalar;
 pub mod vector;
--- a/rust/ffi/node/src/index/scalar.rs
+++ b/rust/ffi/node/src/index/scalar.rs
@@ -1,43 +0,0 @@
-// Copyright 2023 Lance Developers.
-//
-// Licensed under the Apache License, Version 2.0 (the "License");
-// you may not use this file except in compliance with the License.
-// You may obtain a copy of the License at
-//
-//     http://www.apache.org/licenses/LICENSE-2.0
-//
-// Unless required by applicable law or agreed to in writing, software
-// distributed under the License is distributed on an "AS IS" BASIS,
-// WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-// See the License for the specific language governing permissions and
-// limitations under the License.
-
-use neon::{
-    context::{Context, FunctionContext},
-    result::JsResult,
-    types::{JsBoolean, JsBox, JsPromise, JsString},
-};
-
-use crate::{error::ResultExt, runtime, table::JsTable};
-
-pub(crate) fn table_create_scalar_index(mut cx: FunctionContext) -> JsResult<JsPromise> {
-    let js_table = cx.this().downcast_or_throw::<JsBox<JsTable>, _>(&mut cx)?;
-    let column = cx.argument::<JsString>(0)?.value(&mut cx);
-    let replace = cx.argument::<JsBoolean>(1)?.value(&mut cx);
-
-    let rt = runtime(&mut cx)?;
-
-    let (deferred, promise) = cx.promise();
-    let channel = cx.channel();
-    let mut table = js_table.table.clone();
-
-    rt.spawn(async move {
-        let idx_result = table.create_scalar_index(&column, replace).await;
-
-        deferred.settle_with(&channel, move |mut cx| {
-            idx_result.or_throw(&mut cx)?;
-            Ok(cx.undefined())
-        });
-    });
-    Ok(promise)
-}
--- a/rust/ffi/node/src/lib.rs
+++ b/rust/ffi/node/src/lib.rs
@@ -242,10 +242,6 @@ fn main(mut cx: ModuleContext) -> NeonResult<()> {
    cx.export_function("tableCompactFiles", JsTable::js_compact)?;
    cx.export_function("tableListIndices", JsTable::js_list_indices)?;
    cx.export_function("tableIndexStats", JsTable::js_index_stats)?;
-    cx.export_function(
-        "tableCreateScalarIndex",
-        index::scalar::table_create_scalar_index,
-    )?;
    cx.export_function(
        "tableCreateVectorIndex",
        index::vector::table_create_vector_index,
--- a/rust/vectordb/Cargo.toml
+++ b/rust/vectordb/Cargo.toml
@@ -1,6 +1,6 @@
 [package]
 name = "vectordb"
-version = "0.4.1"
+version = "0.4.0"
 edition = "2021"
 description = "LanceDB: A serverless, low-latency vector database for AI applications"
 license = "Apache-2.0"
--- a/rust/vectordb/src/table.rs
+++ b/rust/vectordb/src/table.rs
@@ -14,7 +14,6 @@

 use chrono::Duration;
 use lance::dataset::builder::DatasetBuilder;
-use lance::index::scalar::ScalarIndexParams;
 use lance_index::IndexType;
 use std::sync::Arc;

@@ -263,16 +262,6 @@ impl Table {
        Ok(())
    }

-    /// Create a scalar index on the table
-    pub async fn create_scalar_index(&mut self, column: &str, replace: bool) -> Result<()> {
-        let mut dataset = self.dataset.as_ref().clone();
-        let params = ScalarIndexParams::default();
-        dataset
-            .create_index(&[column], IndexType::Scalar, None, &params, replace)
-            .await?;
-        Ok(())
-    }
-
    pub async fn optimize_indices(&mut self) -> Result<()> {
        let mut dataset = self.dataset.as_ref().clone();
Author	SHA1	Message	Date
Chang She	9eca8e7cd1	tests pass; still need catalog	2023-12-21 20:13:08 -08:00
Chang She	587fe6ffc1	almost	2023-12-21 19:45:10 -08:00
Chang She	89c8e5839b	initial changes to enable an in-memory dataset	2023-12-21 08:52:11 -08:00