Bert
2a9e3e2084
feat(python): support hybrid search in async sdk ( #1915 )
...
fixes: https://github.com/lancedb/lancedb/issues/1765
---------
Co-authored-by: Will Jones <willjones127@gmail.com >
2024-12-06 13:53:15 -05:00
Lance Release
f298f15360
Updating package-lock.json
2024-12-06 17:13:37 +00:00
Lance Release
679b031b99
Bump version: 0.14.0-beta.3 → 0.14.0
2024-12-06 17:13:15 +00:00
Lance Release
f50b5d532b
Bump version: 0.14.0-beta.2 → 0.14.0-beta.3
2024-12-06 17:13:10 +00:00
Lance Release
fe655a15f0
Bump version: 0.17.0-beta.4 → 0.17.0
2024-12-06 17:12:43 +00:00
Lance Release
9d0af794d0
Bump version: 0.17.0-beta.3 → 0.17.0-beta.4
2024-12-06 17:12:43 +00:00
Will Jones
048a2d10f8
fix: data type parsing ( #1918 )
...
Fixes failing test on main
2024-12-06 08:56:07 -08:00
Lei Xu
c78a9849b4
ci: upgrade version of upload-pages-artifact and deploy-pages ( #1917 )
...
For
https://github.blog/changelog/2024-12-05-deprecation-notice-github-pages-actions-to-require-artifacts-actions-v4-on-github-com/
2024-12-06 10:45:24 -05:00
BubbleCal
c663085203
feat: support FTS options on RemoteTable ( #1807 )
2024-12-06 21:49:03 +08:00
Will Jones
8b628854d5
ci: fix nodejs release jobs ( #1912 )
...
* Clean up old commented out jobs
* Fix runner issue that caused these failures:
https://github.com/lancedb/lancedb/actions/runs/12186754094
2024-12-05 14:45:10 -08:00
Will Jones
a8d8c17b2a
docs(rust): fix doctests ( #1913 )
...
* One doctest was running for > 60 seconds in CI, since it was
(unsuccessfully) trying to connect to LanceDB Cloud.
* Fixed the example for `Query::full_text_query()`, which was incorrect.
2024-12-05 14:44:59 -08:00
Will Jones
3c487e5fc7
perf: re-use table instance during write ( #1909 )
...
Previously, whenever `Table.add()` was called, we would write and
re-open the underlying dataset. This was bad for performance, as it
reset the table cache and initiated a lot of IO. It also could be the
source of bugs, since we didn't necessarily pass all the necessary
connection options down when re-opening the table.
Closes #1655
2024-12-05 14:44:50 -08:00
Will Jones
d6219d687c
chore: simplify arrow json conversion ( #1910 )
...
Taking care of a small TODO
2024-12-05 13:14:43 -08:00
Bert
239f725b32
feat(python)!: async-sync feature parity on Connections ( #1905 )
...
Closes #1791
Closes #1764
Closes #1897 (Makes this unnecessary)
BREAKING CHANGE: when using azure connection string `az://...` the call
to connect will fail if the azure storage credentials are not set. this
is breaking from the previous behaviour where the call would fail after
connect, when user invokes methods on the connection.
2024-12-05 14:54:39 -05:00
Will Jones
5f261cf2d8
feat: upgrade to Lance v0.20.0 ( #1908 )
...
Upstream change log:
https://github.com/lancedb/lance/releases/tag/v0.20.0
2024-12-05 10:53:59 -08:00
Will Jones
79eaa52184
feat: schema evolution APIs in all SDKs ( #1851 )
...
* Support `add_columns`, `alter_columns`, `drop_columns` in Remote SDK
and async Python
* Add `data_type` parameter to node
* Docs updates
2024-12-04 14:47:50 -08:00
Lei Xu
bd82e1f66d
feat(python): add support for Azure OpenAPI SDK ( #1906 )
...
Closes #1699
2024-12-04 13:09:38 -08:00
Lance Release
ba34c3bee1
Updating package-lock.json
2024-12-04 01:14:24 +00:00
Lance Release
d4d0873e2b
Bump version: 0.14.0-beta.1 → 0.14.0-beta.2
2024-12-04 01:13:55 +00:00
Lance Release
12c7bd18a5
Bump version: 0.17.0-beta.2 → 0.17.0-beta.3
2024-12-04 01:13:18 +00:00
LuQQiu
c6bf6a25d6
feat: add remote db uri path with folder prefix ( #1901 )
...
Add remote database folder prefix
support db://bucket/path/to/folder/
2024-12-03 16:51:18 -08:00
Weston Pace
c998a47e17
feat: add a pyarrow dataset adapater for LanceDB tables ( #1902 )
...
This currently only works for local tables (remote tables cannot be
queried)
This is also exclusive to the sync interface. However, since the pyarrow
dataset interface is synchronous I am not sure if there is much value in
making an async-wrapping variant.
In addition, I added a `to_batches` method to the base query in the sync
API. This already exists in the async API. In the sync API this PR only
adds support for vector queries and scalar queries and not for hybrid or
FTS queries.
2024-12-03 15:42:54 -08:00
Frank Liu
d8c758513c
feat: add multimodal capabilities for Voyage embedder ( #1878 )
...
Co-authored-by: Will Jones <willjones127@gmail.com >
2024-12-03 10:25:48 -08:00
Will Jones
3795e02ee3
chore: fix ci on main ( #1899 )
2024-12-02 15:21:18 -08:00
Mr. Doge
c7d424b2f3
ci: aarch64-pc-windows-msvc ( #1890 )
...
`npm run pack-build -- -t $TARGET_TRIPLE`
was needed instead of
`npm run pack-build -t $TARGET_TRIPLE`
https://github.com/lancedb/lancedb/pull/1889
some documentation about `*-pc-windows-msvc` cross-compilation (from
alpine):
https://github.com/lancedb/lancedb/pull/1831#issuecomment-2497156918
only `arm64` in `matrix` config is used
since `x86_64` built by `runs-on: windows-2022` is working
2024-12-02 11:17:37 -08:00
Bert
1efb9914ee
ci: fix failing python release ( #1896 )
...
Fix failing python release for windows:
https://github.com/lancedb/lancedb/actions/runs/12019637086/job/33506642964
Also updates pkginfo to fix twine build as suggested here:
https://github.com/pypi/warehouse/issues/15611
failing release:
https://github.com/lancedb/lancedb/actions/runs/12091344173/job/33719622146
2024-12-02 11:05:29 -08:00
Lance Release
83e26a231e
Updating package-lock.json
2024-11-29 22:46:45 +00:00
Lance Release
72a17b2de4
Bump version: 0.14.0-beta.0 → 0.14.0-beta.1
2024-11-29 22:46:20 +00:00
Lance Release
4231925476
Bump version: 0.17.0-beta.1 → 0.17.0-beta.2
2024-11-29 22:45:55 +00:00
Lance Release
84a6693294
Bump version: 0.17.0-beta.0 → 0.17.0-beta.1
2024-11-29 18:16:02 +00:00
Ryan Green
6c2d4c10a4
feat: support remote options for remote lancedb connection ( #1895 )
...
* Support subset of storage options as remote options
* Send Azure storage account name via HTTP header
2024-11-29 14:08:13 -03:30
Ryan Green
d914722f79
Revert "feat: support remote options for remote lancedb connection. Send Azure storage account name via HTTP header."
...
This reverts commit a6e4034dba
2024-11-29 11:06:18 -03:30
Ryan Green
a6e4034dba
feat: support remote options for remote lancedb connection. Send Azure storage account name via HTTP header.
2024-11-29 11:05:04 -03:30
QianZhu
2616a50502
fix: test errors after setting default limit ( #1891 )
2024-11-26 16:03:16 -08:00
LuQQiu
7b5e9d824a
fix: dynamodb external manifest drop table ( #1866 )
...
second pr of https://github.com/lancedb/lancedb/issues/1812
2024-11-26 13:20:48 -08:00
QianZhu
3b173e7cb9
fix: default limit for remote nodejs client ( #1886 )
...
https://github.com/lancedb/lancedb/issues/1804
2024-11-26 11:01:25 -08:00
Mr. Doge
d496ab13a0
ci: linux: specify target triple for neon pack-build (vectordb) ( #1889 )
...
fixes that all `neon pack-build` packs are named
`vectordb-linux-x64-musl-*.tgz` even when cross-compiling
adds 2nd param:
`TARGET_TRIPLE=${2:-x86_64-unknown-linux-gnu}`
`npm run pack-build -- -t $TARGET_TRIPLE`
2024-11-26 10:57:17 -08:00
Will Jones
69d9beebc7
docs: improve style and introduction to Python API docs ( #1885 )
...
I found the signatures difficult to read and the parameter section not
very space efficient.
2024-11-26 09:17:35 -08:00
Bert
d32360b99d
feat: support overwrite and exist_ok mode for remote create_table ( #1883 )
...
Support passing modes "overwrite" and "exist_ok" when creating a remote
table.
2024-11-26 11:38:36 -05:00
Will Jones
9fa08bfa93
ci: use correct runner for vectordb ( #1881 )
...
We already do this for `gnu` builds, we should do this also for `musl`
builds.
2024-11-25 16:17:10 -08:00
LuQQiu
d6d9cb7415
feat: bump lance to 0.20.0b3 ( #1882 )
...
Bump lance version.
Upstream change log:
https://github.com/lancedb/lance/releases/tag/v0.20.0-beta.3
2024-11-25 16:15:44 -08:00
Lance Release
990d93f553
Updating package-lock.json
2024-11-25 22:06:39 +00:00
Lance Release
0832cba3c6
Bump version: 0.13.1-beta.0 → 0.14.0-beta.0
2024-11-25 22:06:14 +00:00
Lance Release
38b0d91848
Bump version: 0.16.1-beta.0 → 0.17.0-beta.0
2024-11-25 22:05:49 +00:00
Will Jones
6826039575
fix(python): run remote SDK futures in background thread ( #1856 )
...
Users who call the remote SDK from code that uses futures (either
`ThreadPoolExecutor` or `asyncio`) can get odd errors like:
```
Traceback (most recent call last):
File "/usr/lib/python3.12/asyncio/events.py", line 88, in _run
self._context.run(self._callback, *self._args)
RuntimeError: cannot enter context: <_contextvars.Context object at 0x7cfe94cdc900> is already entered
```
This PR fixes that by executing all LanceDB futures in a dedicated
thread pool running on a background thread. That way, it doesn't
interact with their threadpool.
2024-11-25 13:12:47 -08:00
QianZhu
3e9321fc40
docs: improve scalar index and filtering ( #1874 )
...
improved the docs on build a scalar index and pre-/post-filtering
---------
Co-authored-by: Weston Pace <weston.pace@gmail.com >
2024-11-25 11:30:57 -08:00
Lei Xu
2ded17452b
fix(python)!: handle bad openai embeddings gracefully ( #1873 )
...
BREAKING-CHANGE: change Pydantic Vector field to be nullable by default.
Closes #1577
2024-11-23 13:33:52 -08:00
Mr. Doge
dfd9d2ac99
ci: musl missing node/package.json targets ( #1870 )
...
I missed targets when manually merging draft PR to updated main
I was copying from:
https://github.com/lancedb/lancedb/pull/1816/files#diff-d6e19f28e97cfeda63a9bd9426f10f1d2454eeed375ee1235e8ba842ceeb46a0
fixes:
error: Rust target x86_64-unknown-linux-musl not found in package.json.
2024-11-22 10:40:59 -08:00
Lance Release
162880140e
Updating package-lock.json
2024-11-21 21:53:25 +00:00
Lance Release
99d9ced6d5
Bump version: 0.13.0 → 0.13.1-beta.0
2024-11-21 21:53:01 +00:00
