rust/lancedb
1
0
Fork 0
mirror of https://github.com/lancedb/lancedb.git synced 2026-10-04 10:55:43 +00:00
Code Issues Packages Projects Releases Wiki Activity
779 Commits 367 Branches 547 Tags
cf3dbcf684a78c8bac62467b737d25c4d3a525df
Commit Graph
75 Commits
Author SHA1 Message Date
Will Jones cf3dbcf684 ci: fix Node ARM release build (#971) 
When we turned on fat LTO builds, we made the release build job **much**
more compute and memory intensive. The ARM runners have particularly low
memory per core, which makes them susceptible to OOM errors. To avoid
issues, I have enabled memory swap on ARM and bumped the side of the
runner.
 2024-04-05 16:30:36 -07:00
Will Jones c425d3759d ci: reduce number of build jobs on aarch64 to avoid OOM (#970) 2024-04-05 16:30:36 -07:00
Weston Pace da47938a43 chore: use a bigger runner for NPM publish jobs on aarch64 to avoid OOM (#955) 2024-04-05 16:30:06 -07:00
Ayush Chaurasia d07817a562 feat(python): Reranker DX improvements (#904) 
- Most users might not know how to use `QueryBuilder` object. Instead we
should just pass the string query.
- Add new rerankers: Colbert, openai
 2024-04-05 16:29:58 -07:00
Lei Xu bd2d187538 ci: bump to new version of python action to use node 20 gIthub action runtime (#909) 
Github action is deprecating old node-16 runtime.
 2024-04-05 16:29:05 -07:00
Lei Xu a617ad35ff ci: change apple silicon runner to free OSS macos-14 target (#901) 2024-04-05 16:28:56 -07:00
Lei Xu 12e776821a doc: use snippet for rust code example and make sure rust examples run through CI (#885) 2024-04-05 16:28:56 -07:00
Lei Xu c6e5eb0398 fix: fix doc build to include the source snippet correctly (#883) 2024-04-05 16:28:56 -07:00
Lei Xu e7fdb931de chore: convert all js doc test to use snippet. (#881) 2024-04-05 16:28:56 -07:00
Lei Xu d811b89de2 doc: use code snippet for typescript examples (#880) 
The typescript code is in a fully function file, that will be run via the CI.
 2024-04-05 16:28:56 -07:00
Lei Xu f2e29eb004 chore: upgrade lance, pylance and datafusion (#879) 2024-04-05 16:28:56 -07:00
Lei Xu faa5912c3f chore: bump github actions to v4 due to GHA warnings of node version deprecation (#874) 2024-04-05 16:28:56 -07:00
Lei Xu efcaa433fe feat: rework NodeJS SDK using napi (#847) 
Use Napi to write a Node.js SDK that follows Polars for better
maintainability, while keeping most of the logic in Rust.
 2024-04-05 16:27:51 -07:00
Lei Xu 65c1d8bc4c feat: change create table to accept Arrow table (#845) 2024-04-05 16:27:50 -07:00
Lei Xu 5b2c602fb3 doc: improve docs for nodejs connect functions (#833) 
* improve the docstring for NodeJS connect functions and
`ConnectOptions` parameters.
* Simplify `npm run build` steps.
 2024-04-05 16:27:32 -07:00
Will Jones 5f6d13e958 ci: lint and enforce linting (#829) 
@eddyxu added instructions for linting here:

https://github.com/lancedb/lancedb/blob/7af213801a091cd5afb0f0814e184fc0b852de47/python/README.md?plain=1#L45-L50

However, we had a lot of failures and weren't checking this in CI. This
PR fixes all lints and adds a check to CI to keep us in compliance with
the lints.
 2024-04-05 16:27:31 -07:00
Lei Xu 45b006d68c chore: remove black as dependency (#808) 
We use `ruff` in CI and dev workflow now.
 2024-04-05 16:25:02 -07:00
QianZhuandAidan 25d1c62c3f SaaS JS API sdk doc (#740) 
Co-authored-by: Aidan <64613310+aidangomar@users.noreply.github.com>
 2024-04-05 16:24:47 -07:00
Chang SheandWill Jones 009297e900 bug(python): fix path handling in windows (#724) 
Use pathlib for local paths so that pathlib
can handle the correct separator on windows.

Closes #703

---------

Co-authored-by: Will Jones <willjones127@gmail.com>
 2024-04-05 16:24:45 -07:00
Will Jones c3cda2c5d0 ci: check formatting and clippy (#730) 2024-04-05 16:24:30 -07:00
Chang She 374a6f7e78 feat: support nested pydantic schema (#707) 2024-04-05 16:24:30 -07:00
Will Jones e52f691420 ci: fix broken npm publication (#704) 
Most recent release failed because `release` depends on `node-macos`,
but we renamed `node-macos` to `node-macos-{x86,arm64}`. This fixes that
by consolidating them back to a single `node-macos` job, which also has
the side effect of making the file shorter.
 2024-04-05 16:24:30 -07:00
Chang She fb1de97e83 chore: Use m1 runner for npm publish (#687) 
We had some build issues with npm publish for cross-compiling arm64
macos on an x86 macos runner. Switching to m1 runner for now until
someone has time to deal with the feature flags.

follow-up tracked here: #688
 2024-04-05 16:23:49 -07:00
Lei Xu 49306a99ba chore: apple silicon runner (#633) 
Close #632
 2024-04-05 16:23:49 -07:00
Lei Xu 86efd36689 chore: improve create_table API consistency between local and remote SDK (#627) 2024-04-05 16:23:47 -07:00
Bert 4e9aab9e8b ci: cancel in progress runs on new push (#620) 2024-04-05 16:22:59 -07:00
Will Jones 166b281d66 increment pylance (#618) 2024-04-05 16:22:59 -07:00
Chang She f20f19b804 feat: improve pydantic 1.x compat (#503) 2023-09-18 19:01:30 -07:00
Chang SheandChang She c21f9cdda0 ci: fix docs build (#496) 
python/python.md contains typos in the class references

---------

Co-authored-by: Chang She <chang@lancedb.com>
 2023-09-18 13:07:21 -07:00
Rob Meng 731f86e44c add health check to wait for all service ready before next step (#501) 
aws integration tests are flaky because we didn't wait for the services
to become healthy. (we only waited for the localstack service, this PR
adds wait for sub services)
 2023-09-18 15:17:45 -04:00
Chang She 31dad71c94 multi-modal embedding-function (#484) 2023-09-16 21:23:51 -04:00
Rob Meng 0554db03b3 progagate uri query string to lance; add aws integration tests (#486) 
# WARNING: specifying engine is NOT a publicly supported feature in
lancedb yet. THE API WILL CHANGE.

This PR exposes dynamodb based commit to `vectordb` and JS SDK (will do
python in another PR since it's on a different release track)

This PR also added aws integration test using `localstack`

## What?
This PR adds uri parameters to DB connection string. User may specify
`engine` in the connection string to let LanceDB know that the user
wants to use an external store when reading and writing a table. User
may also pass any parameters required by the commitStore in the
connection string, these parameters will be propagated to lance.

e.g.
```
vectordb.connect("s3://my-db-bucket?engine=ddb&ddbTableName=my-commit-table")
```
will automatically convert table path to
```
s3+ddb://my-db-bucket/my_table.lance?&ddbTableName=my-commit-table
```
 2023-09-09 13:33:16 -04:00
Leon Yee cf977866d8 [WIP] Workflow to trigger vectordb-recipes workflow (#371) 2023-08-02 11:27:08 -07:00
gsilvestrin 1daecac648 fix(python): Pin pylance and add pandas as test dependency (#373) 2023-07-27 15:21:45 -07:00
Will Jones 8829988ada ci: build node in manylinux docker container (#350) 
Closes #359

TODO:
 * [x] test in a sample of Linux distro docker containers
 2023-07-24 11:31:47 -07:00
gsilvestrin 4383848d53 feat(node): Add Linux ARM build (#348) 2023-07-21 15:33:02 -07:00
gsilvestrin 473c43860c bugfix: Set Github token when pushing changes (#351) 2023-07-21 15:31:44 -07:00
gsilvestrin 21b1a71a6b bugfix(node): Don't persist credentials on make-release-commit.yml (#345) 2023-07-20 13:24:06 -07:00
gsilvestrin 2d899675e8 bugfix(node): Make release task can't push to repo (#344) 2023-07-20 13:15:29 -07:00
gsilvestrin a2bb497135 feat(node) Move native packages to @lancedb NPM org (#341) 
- Move native packages to @lancedb org
- Move package-lock.json update to a reusable action and created a target to run it manually.
 2023-07-20 12:54:39 -07:00
gsilvestrin b45ac4608f feat(node): Explicitly set registry url when publishing package (#324) 2023-07-18 08:55:56 -07:00
gsilvestrin 6271949d38 feat(node): Update package-lock.json on each release (#302) 2023-07-17 16:33:43 -07:00
gsilvestrin 72afa06b7a feat(node): Add Windows support (#294) 2023-07-17 08:48:24 -07:00
gsilvestrin aecc5fc42b feat(node): Fix npm publish task (#298) 2023-07-14 13:39:15 -07:00
Tevin Wang ad18826579 [Documentation Code Testing] build node sdk in release (#307) 2023-07-14 12:46:48 -07:00
gsilvestrin c385c55629 feat(node): pull node binaries into separate packages (3) (#285) 2023-07-12 16:52:04 -07:00
gsilvestrin caf22fdb71 Run rust tests when Cargo.toml changes (#276) 2023-07-11 11:19:06 -07:00
Leon Yee a5eb665b7d [docs] dynamic docs generation and deployment (#253) 
Solves #245 , edited docs.yml to run the generation of docs before
deployment. Tested on a test repository
 2023-07-06 21:10:36 -07:00
Chang SheandChang She e2325c634b Allow creation of an empty table (#254) 
It's inconvenient to always require data at table creation time.
Here we enable you to create an empty table and add data and set schema
later.

---------

Co-authored-by: Chang She <chang@lancedb.com>
 2023-07-06 20:44:58 -07:00
Tevin Wang 39479dcf8e fix sha error in npm (#236) 
Currently getting a `npm ERR! code EINTEGRITY` on merge, need to fix
asap.


https://stackoverflow.com/questions/75905223/github-action-npm-install-give-code-eintegrity-integrity-checksum-failed
 2023-06-29 09:31:23 -07:00