rust/lancedb
1
0
Fork 0
mirror of https://github.com/lancedb/lancedb.git synced 2026-09-05 21:09:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,085 Commits 319 Branches 524 Tags
1c229a90ea86f09ffcef53240c445b052103c501
Commit Graph
1085 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
albertlockett 1c229a90ea support passing WriteParams to update 2024-07-18 15:09:58 -03:00
rmeng cc114ada72 feat: upgrade to 0.14.2 2024-07-13 21:25:59 -04:00
Lance Release 92c93b08bf Updating package-lock.json 2024-07-13 08:56:11 +00:00
Lance Release a363b02ca7 Bump version: 0.7.0-beta.0 → 0.7.0 v0.7.0 2024-07-13 08:55:44 +00:00
Lance Release ff8eaab894 Bump version: 0.6.0 → 0.7.0-beta.0 2024-07-13 08:55:44 +00:00
Lance Release 11959cc5d6 Bump version: 0.10.0-beta.0 → 0.10.0 python-v0.10.0 2024-07-13 08:55:22 +00:00
Lance Release 7c65cec8d7 Bump version: 0.9.0 → 0.10.0-beta.0 2024-07-13 08:55:22 +00:00
Adam Azzam 82621d5b13 chore: typing for lance.connect (#1441) 
Feel free to close if this is a distraction, but untyped keywords in
lance.connect is throwing pylance errors in strict mode.

<img width="683" alt="Screenshot 2024-07-11 at 1 21 04 PM"
src="https://github.com/lancedb/lancedb/assets/33043305/fe6cd4d9-4e59-413d-87f2-aabb9ff84cc4">
 2024-07-12 10:39:28 -07:00
Lei Xu 0708428357 feat: support update over binary field (#1440) 2024-07-12 09:22:00 -07:00
BubbleCal 137d86d3c5 chore: bump lance to 0.14.1 (#1442) 
Signed-off-by: BubbleCal <bubble-cal@outlook.com>
 2024-07-12 21:41:59 +08:00
Ayush Chaurasia bb2e624ff0 docs: add fine tuning section in retriever guide and minor fixes (#1438) 2024-07-11 17:34:29 +05:30
Cory Grinstead fdc949bafb feat(nodejs): update({values | valuesSql}) (#1439) 2024-07-10 14:09:39 -05:00
Cory GrinsteadandWill Jones 31be9212da docs(nodejs): add @lancedb/lancedb examples everywhere (#1411) 
Co-authored-by: Will Jones <willjones127@gmail.com>
 2024-07-10 13:29:03 -05:00
Joan Fontanals cef24801f4 docs: add jina reranker to index (#1427) 
PR to add JinaReranker documentation page to the rerankers index
 2024-07-09 14:39:35 +05:30
forrestmckee b4436e0804 refactor: update type hint and remove unused import (#1436) 
change typehint on `_invert_score` from `List[float]` to `float`. remove
unnecessary typing import
 2024-07-09 13:56:45 +05:30
Lei Xu 58c2cd01a5 docs: add fast search to openapi.yml (#1435) 2024-07-08 11:55:45 -07:00
Cory Grinstead a1a1891c0c fix(nodejs): explain plan (#1434) 2024-07-08 13:07:24 -05:00
Lei Xu 3c6c21c137 feat(rust): enable fast search flag in rust (#1432) 2024-07-07 09:46:41 -07:00
Lei Xu fd5ca20f34 chore: bump lance to 0.14 (#1430) 2024-07-06 14:10:42 -07:00
Lei Xu ef30f87fd1 chore: propagate error for table index stats (#1426) 2024-07-04 14:53:49 -07:00
Joan Fontanals 08d25c5a80 feat: add Jina integration in Python for Embedding and Reranker (#1424) 
Integration of Jina Embeddings and Rerankers through its API
 2024-07-05 01:34:43 +05:30
Raghav Dixit a5ff623443 docs: update lntegration docs & fixed links (#1423) 
1. Updated langchain docs. 
2. Minor update to llamaindex doc.
3. Added notebook examples and linked them correctly
 2024-07-03 21:50:33 +05:30
Cory Grinstead b8ccea9f71 feat(nodejs): make tbl.search chainable (#1421) 
so this was annoying me when writing the docs. 

for a `search` query, one needed to chain `async` calls.

```ts
const res = await (await tbl.search("greetings")).toArray()
```

now the promise will be deferred until the query is collected, leading
to a more functional API

```ts
const res = await tbl.search("greetings").toArray()
```
 2024-07-02 14:31:57 -05:00
NuvicandWill Jones 46c6ff889d feat: add the explain_plan function (#1328) 
It's useful to see the underlying query plan for debugging purposes.
This exposes LanceScanner's `explain_plan` function. Addresses #1288

---------

Co-authored-by: Will Jones <willjones127@gmail.com>
 2024-07-02 11:10:01 -07:00
BubbleCal 12b3c87964 feat: support to create more vector index types (#1407) 
Signed-off-by: BubbleCal <bubble-cal@outlook.com>
 2024-07-02 10:53:03 -02:30
Lei XuandWeston Pace 020a437230 docs: add merge insert, create index and create scalar index to public rest api doc (#1420) 
Added 3 APIs doc publicly:
- `merge_insert`
- `create_index`
- `create_scalar_index`

---------

Co-authored-by: Weston Pace <weston.pace@gmail.com>
 2024-07-01 12:52:27 -07:00
Cory Grinstead 34f1aeb84c chore(nodejs): make opean optional, and apache-arrow a peer dep (#1417) 
fyi, this should have no breaking changes as npm is opt-out instead of
opt-in when resolving dependencies

all peer and optional dependencies get installed by default, so users
need to manually opt out.

`npm i --omit optional --omit peer`
 2024-07-01 12:50:01 -05:00
Cory Grinstead 5c3a88b6b2 feat(nodejs): add better typehints for registry (#1408) 
previously the `registry` would return `undefined | EmbeddingFunction`
even for built in functions such as "openai"

now it'll return the correct type for `getRegistry().get("openai")

as well as pass in the correct options type to `create`

### before
```ts
const options: {model: 'not-a-real-model'}
// this'd compile just fine, but result in runtime error
const openai: EmbeddingFunction | undefined = getRegistry().get("openai").create(options)
// this'd also compile fine
const openai: EmbeddingFunction | undefined = getRegistry().get("openai").create({MODEL: ''})
```
### after
```ts
const options: {model: 'not-a-real-model'}

const openai: OpenAIEmbeddingFunction = getRegistry().get("openai").create(options)
// Type '"not-a-real-model"' is not assignable to type '"text-embedding-ada-002" | "text-embedding-3-large" | "text-embedding-3-small" | undefined'


```
 2024-07-01 12:49:42 -05:00
Lei Xu e780b2f51c ci: fix nodejs doc test (#1419) 
Fixed nodejs doctest failures due to compiling JNI node.
 2024-07-01 10:21:41 -07:00
Cory Grinstead b8a1719174 feat(nodejs): catch unwinds in node bindings (#1414) 
this bumps napi version to 2.16 which contains a few bug fixes.
Additionally, it adds `catch_unwind` to any method that may
unintentionally panic.

`catch_unwind` will unwind the panics and return a regular JS error
instead of panicking.
 2024-07-01 09:28:10 -05:00
Ayush Chaurasia ccded130ed docs: add reranking example (#1416) 2024-07-01 19:42:38 +05:30
Sidharth Rajaram 48f8d1b3b7 docs: addresses typos in HF embedding example docs (#1415) 
* `table.add` requires `data` parameter on the docs page regarding use
of embedding models from HF
* also changed the name of example class from `TextModel` to `Words`
since that is what is used as parameter in the `db.create_table` call
* Per
https://lancedb.github.io/lancedb/python/python/#lancedb.table.Table.add
 2024-07-01 12:14:17 +05:30
Will Jonesanduniversalmind303 865ed99881 feat: dynamodb commit store support (#1410) 
This allows users to specify URIs like:

```
s3+ddb://my_bucket/path?ddbTableName=myCommitTable
```

and it will support concurrent writes in S3.

* [x] Add dynamodb integration tests
* [x] Add modifications to get it working in Python sync API
* [x] Added section in documentation describing how to configure.

Closes #534

---------

Co-authored-by: universalmind303 <cory.grinstead@gmail.com>
 2024-06-28 09:30:36 -07:00
Lei Xu d6485f1215 docs: add openapi rest api page (#1413) 2024-06-27 21:32:34 -07:00
Cory Grinstead 79a1667753 feat(nodejs): feature parity [6/N] - make public interface work with multiple arrow versions (#1392) 
previously we didnt have great compatibility with other versions of
apache arrow. This should bridge that gap a bit.


depends on https://github.com/lancedb/lancedb/pull/1391
see actual diff here
https://github.com/universalmind303/lancedb/compare/query-filter...universalmind303:arrow-compatibility
 2024-06-25 11:10:08 -05:00
Thomas J. Fan a866b78a31 docs: fixes polars formatting in docs (#1400) 
Currently, the whole polars section is formatted as a code block:
https://lancedb.github.io/lancedb/guides/tables/#from-a-polars-dataframe

This PR fixes the formatting.
 2024-06-25 08:46:16 -07:00
Will Jones c7d37b3e6e docs: add tip about lzma linking (#1397) 
Similar to https://github.com/lancedb/lance/pull/2505
 2024-06-25 08:20:31 -07:00
Lance Release 4b71552b73 Updating package-lock.json 2024-06-25 00:26:08 +00:00
Lance Release 5ce5f64da3 Bump version: 0.6.0-beta.0 → 0.6.0 v0.6.0 2024-06-25 00:25:45 +00:00
Lance Release c582b0fc63 Bump version: 0.5.2 → 0.6.0-beta.0 2024-06-25 00:25:45 +00:00
Lance Release bc0814767b Bump version: 0.9.0-beta.0 → 0.9.0 python-v0.9.0 2024-06-25 00:25:27 +00:00
Lance Release 8960a8e535 Bump version: 0.8.2 → 0.9.0-beta.0 2024-06-25 00:25:27 +00:00
Weston Pace a8568ddc72 feat: upgrade to lance 0.13.0 (#1404) 2024-06-24 17:22:57 -07:00
Cory Grinstead 55f88346d0 feat(nodejs): table.indexStats (#1361) 
closes https://github.com/lancedb/lancedb/issues/1359
 2024-06-21 17:06:52 -05:00
Will Jones dfb9a28795 ci(node): add description and keywords for lancedb package (#1398) 2024-06-21 14:43:35 -07:00
Cory Grinstead a797f5fe59 feat(nodejs): feature parity [5/N] - add query.filter() alias (#1391) 
to make the transition from `vectordb` to `@lancedb/lancedb` as seamless
as possible, this adds `query.filter` with a deprecated tag.


depends on https://github.com/lancedb/lancedb/pull/1390
see actual diff here
https://github.com/universalmind303/lancedb/compare/list-indices-name...universalmind303:query-filter
 2024-06-21 16:03:58 -05:00
Cory Grinstead 3cd84c9375 feat(nodejs): feature parity [4/N] - add 'name' to 'IndexConfig' for 'listIndices' (#1390) 
depends on https://github.com/lancedb/lancedb/pull/1386

see actual diff here
https://github.com/universalmind303/lancedb/compare/create-table-args...universalmind303:list-indices-name
 2024-06-21 15:45:02 -05:00
Cory Grinstead 5ca83fdc99 fix(node): node build (#1396) 
i have no idea why this fixes the build.
 2024-06-21 15:42:22 -05:00
Cory Grinstead 33cc9b682f feat(nodejs): feature parity [3/N] - createTable({name, data, ...options}) (#1386) 
adds support for the `vectordb` syntax of `createTable({name, data,
...options})`.


depends on https://github.com/lancedb/lancedb/pull/1380
see actual diff here
https://github.com/universalmind303/lancedb/compare/table-name...universalmind303:create-table-args
 2024-06-21 12:17:39 -05:00
Cory Grinstead b3e5ac6d2a feat(nodejs): feature parity [2/N] - add table.name and lancedb.connect({args}) (#1380) 
depends on https://github.com/lancedb/lancedb/pull/1378

see proper diff here
https://github.com/universalmind303/lancedb/compare/remote-table-node...universalmind303:lancedb:table-name
 2024-06-21 11:38:26 -05:00