rust/lancedb
1
0
Fork 0
mirror of https://github.com/lancedb/lancedb.git synced 2026-01-10 13:52:58 +00:00
Code Issues Packages Projects Releases Wiki Activity
871 Commits 116 Branches 397 Tags
81f2cdf7360bc472a63f3b081e6f45c0cbddc2e7
Commit Graph

59 Commits

Author SHA1 Message Date
Will Jones
9bc320874a fix: handle uri in object (#1091) 
Fixes #1078
 2024-03-12 13:25:56 -07:00
QianZhu
c1af53b787 Add create scalar index to sdk (#1033) 2024-02-29 13:32:01 -08:00
Will Jones
5af74b5aca feat: {add|alter|drop}_columns APIs (#1015) 
Initial work for #959. This exposes the basic functionality for each in
all of the APIs. Will add user guide documentation in a later PR.
 2024-02-26 11:04:53 -08:00
Will Jones
3aa0c40168 feat(node): add read_consistency_interval to Node and Rust (#1002) 
This PR adds the same consistency semantics as was added in #828. It
*does not* add the same lazy-loading of tables, since that breaks some
existing tests.

This closes #998.

---------

Co-authored-by: Weston Pace <weston.pace@gmail.com>
 2024-02-22 15:04:30 -08:00
Weston Pace
cc5f2136a6 feat: make it easier to create empty tables (#942) 
This PR also reworks the table creation utilities significantly so that
they are more consistent, built on top of each other, and thoroughly
documented.
 2024-02-13 10:51:18 -08:00
Weston Pace
a9727eb318 feat: add support for filter during merge insert when matched (#948) 
Closes #940
 2024-02-09 10:26:14 -08:00
Weston Pace
d2e71c8b08 feat: add a filterable count_rows to all the lancedb APIs (#913) 
A `count_rows` method that takes a filter was recently added to
`LanceTable`. This PR adds it everywhere else except `RemoteTable` (that
will come soon).
 2024-02-08 09:40:29 -08:00
Weston Pace
7f8637a0b4 feat: add merge_insert to the node and rust APIs (#915) 2024-02-02 13:16:51 -08:00
Lei Xu
5f59e51583 fix(node): pass AWS credentials to db level operations (#908) 
Passed the following tests

```ts
const keyId = process.env.AWS_ACCESS_KEY_ID;
const secretKey = process.env.AWS_SECRET_ACCESS_KEY;
const sessionToken = process.env.AWS_SESSION_TOKEN;
const region = process.env.AWS_REGION;

const db = await lancedb.connect({
  uri: "s3://bucket/path",
  awsCredentials: {
    accessKeyId: keyId,
    secretKey: secretKey,
    sessionToken: sessionToken,
  },
  awsRegion: region,
} as lancedb.ConnectionOptions);

  console.log(await db.createTable("test", [{ vector: [1, 2, 3] }]));
  console.log(await db.tableNames());
  console.log(await db.dropTable("test"))
```
 2024-01-31 12:05:01 -08:00
Lei Xu
22b9eceb12 chore: convert all js doc test to use snippet. (#881) 2024-01-28 11:39:25 -08:00
Lei Xu
ccfd043939 feat: change create table to accept Arrow table (#845) 2024-01-23 13:25:15 -08:00
Bert
66eaa2a00e allow passing api key as env var (#841) 
Allow passing API key as env var:
```shell
export LANCEDB_API_KEY=sh_123...
```

with this set, apiKey argument can omitted from `connect`
```js
    const db = await vectordb.connect({
        uri: "db://test-proj-01-ae8343",
        region: "us-east-1",
  })
```
```py
    db = lancedb.connect(
        uri="db://test-proj-01-ae8343",
        region="us-east-1",
    )
```
 2024-01-22 16:18:28 -05:00
Lei Xu
5f14a411af feat(js): add helper function to create Arrow Table with schema (#838) 
Support to make Apache Arrow Table from an array of javascript Records,
with optionally provided Schema.
 2024-01-22 11:49:44 -08:00
Lei Xu
9a9fc77a95 doc: improve docs for nodejs connect functions (#833) 
* improve the docstring for NodeJS connect functions and
`ConnectOptions` parameters.
* Simplify `npm run build` steps.
 2024-01-19 16:07:53 -08:00
Chang She
81af350d85 feat(node): align incoming data to table schema (#802) 2024-01-10 16:44:00 -08:00
Chang She
ac40d4b235 feat(node): support table.schema for LocalTable (#789) 
Close #773 

we pass an empty table over IPC so we don't need to manually deal with
serde. Then we just return the schema attribute from the empty table.

---------

Co-authored-by: albertlockett <albert.lockett@gmail.com>
 2024-01-08 21:12:48 -08:00
Bert
756188358c docs: fix JS api docs for update method (#738) 2023-12-21 13:48:00 -05:00
Weston Pace
dc5126d8d1 feat: add the ability to create scalar indices (#679) 
This is a pretty direct binding to the underlying lance capability
 2023-12-21 09:50:10 -08:00
Aidan
fff8e399a3 feat: Node create index API (#720) 2023-12-20 15:22:35 -05:00
Chang She
098e397cf0 feat: LocalTable for vectordb now supports filters without vector search (#693) 
Note this currently the filter/where is only implemented for LocalTable
so that it requires an explicit cast to "enable" (see new unit test).
The alternative is to add it to the Table interface, but since it's not
available on RemoteTable this may cause some user experience issues.
 2023-12-13 22:59:01 -08:00
Bert
63ee8fa6a1 Update in Node & Rust (#696) 
Co-authored-by: Will Jones <willjones127@gmail.com>
 2023-12-13 14:53:06 -05:00
Bert
5ca98c326f feat: added dataset stats api to node (#604) 2023-10-26 17:00:48 -04:00
Will Jones
db7bdefe77 feat: cleanup and compaction (#518) 
#488
 2023-10-11 12:49:12 -07:00
Rob Meng
30f5bc5865 expose awsRegion to be configurable (#441) 2023-08-22 16:00:14 -04:00
gsilvestrin
2737315cb2 feat(node): Create empty tables / Arrow Tables (#399) 
- Supports creating an empty table as long as an Arrow Schema is provided
- Supports creating a table from an Arrow Table (can be passed as data)
- Simplified some Arrow code in the TS/FFI side
- removed createTableArrow method, it was never documented / tested.
 2023-08-22 10:57:45 -07:00
Rob Meng
d52422603c use a lambda function to hide the value of credentials when printing a connection/table (#438) 
Previously when logging the `LocalConnection` and `LocalTable` classes,
we would expose the aws creds inside them. This PR changes the stored
creds to a anonymous function to hide the creds
 2023-08-21 23:06:44 -04:00
Rob Meng
f0bcb26f32 Upgrade lance and pass AWS creds when opening a table (#426) 2023-08-14 18:22:02 -04:00
gsilvestrin
f227658e08 fix(node) Remove mpsc from JS SDK (#407) 
- Callers / SDKs are responsible for keeping track of the last version of the Table
-  Remove the mpsc from Table and make all Table operations non-blocking
 2023-08-08 10:35:43 -07:00
gsilvestrin
b69b1e3ec8 fix(node) Unit tests hangs and don't exit (#396) 2023-08-04 20:18:23 -07:00
gsilvestrin
80a32be121 bugfix(node): make WriteMode optional when specifying embeddings (#336) 2023-07-24 11:26:43 -07:00
Rob Meng
a636bb1075 add support for host override (#335) 2023-07-18 21:21:39 -04:00
Lei Xu
980f910f50 [Node] initial support of nodejs remote sdk (#333) 2023-07-18 16:15:27 -07:00
Will Jones
3537afb2c3 docs: show how to delete rows in user guide (#309) 
Closes #265
 2023-07-18 08:19:48 -07:00
gsilvestrin
826dc90151 feat(node): add option object to connect method (#286) 2023-07-13 11:03:48 -07:00
Rob Meng
98b12caa06 export create table with aws credentials (#282) 2023-07-11 17:21:10 -04:00
Rob Meng
ace6aa883a Upgrade lance to 0.5.5, and plumb thru new features from the upgrade (#279) 
* upgrade
* fixes for the upgrade
* allow JS users to pass custom AWS credentials
 2023-07-11 16:33:39 -04:00
Lei Xu
dc7146b2cb [Node] Expose IVF PQ config (#258) 2023-07-05 19:54:21 -07:00
Leon Yee
9600a38ff0 [docs] fixed javascript docs for overloaded functions (#247) 
Solves #244 :


![image](https://github.com/lancedb/lancedb/assets/43097991/d1fd9d2a-0d6a-4c16-a0ab-f460cc709349)

Problem was function overloading in the interface caused some weird
`typedoc` formatting, so breaking it apart into methods fixed the issue.

Also regenerated and updated javascript docs

---------

Co-authored-by: Tevin Wang <tevin@cmu.edu>
 2023-07-04 13:07:34 -07:00
Lei Xu
fc725c99f0 [Node] Create Table with WriteMode (#246) 
Support `createTable(name, data, mode?)`  to be consistent with Python.

Closes #242
 2023-07-03 17:04:21 -07:00
Lei Xu
051c03c3c9 Add dot product support (#239) 
Closes #207
 2023-06-29 10:32:01 -07:00
Rob Meng
01abf82808 Refactor TS client to use interface + implementation pattern (#226) 
## What?
* Changed `Connection` and `Table` to interfaces
* Renamed original `Connection` and `Table` to `LocalConnection` and
`LocalTable`
 2023-06-27 21:45:01 -04:00
Lei Xu
c68c236f17 [Js] Create index with replace flag (#229) 2023-06-26 18:38:20 -07:00
Lei Xu
c14ad91df0 [Node] drop table api (#221) 
Provide `drop_table` in rust and node. Closes #86
 2023-06-23 19:58:37 -07:00
Will Jones
ad48242ffb feat: support for deletion (#219) 
Also upgrades Arrow and Lance.
 2023-06-23 18:09:07 -07:00
gsilvestrin
78de8f5782 feat(node): add Table.countRows() (#185) 2023-06-15 14:35:54 -07:00
gsilvestrin
f65d85efcc feat(node): add where method to query builder (#183) 
Closes #181
 2023-06-14 10:54:43 -07:00
gsilvestrin
f37994b72a [nodejs] deprecated created_index in favor of createIndex. (#145) 2023-06-03 11:05:35 -07:00
gsilvestrin
d0c47e3838 added projection api for nodejs (#140) 2023-06-03 10:34:08 -07:00
gsilvestrin
3e14b357e7 add openai embedding function to nodejs client (#107) 
- openai is an optional dependency for lancedb
- added an example to show how to use it
 2023-06-01 10:25:00 -07:00
Lei Xu
306ada5cb8 Support S3 and GCS from typescript SDK (#106) 2023-05-30 21:32:17 -07:00