Commit Graph

1437 Commits

Author SHA1 Message Date
Will Jones 980aa70e2d feat(python): async-sync feature parity on Table (#1914)
### Changes to sync API
* Updated `LanceTable` and `LanceDBConnection` reprs
* Add `storage_options`, `data_storage_version`, and
`enable_v2_manifest_paths` to sync create table API.
* Add `storage_options` to `open_table` in sync API.
* Add `list_indices()` and `index_stats()` to sync API
* `create_table()` will now create only 1 version when data is passed.
Previously it would always create two versions: 1 to create an empty
table and 1 to add data to it.

### Changes to async API
* Add `embedding_functions` to async `create_table()` API.
* Added `head()` to async API

### Refactors
* Refactor index parameters into dataclasses so they are easier to use
from Python
* Moved most tests to use an in-memory DB so we don't need to create so
many temp directories

Closes #1792
Closes #1932

---------

Co-authored-by: Weston Pace <weston.pace@gmail.com>
2024-12-13 12:56:44 -08:00
Lance Release d83e5a0208 Updating package-lock.json 2024-12-13 05:34:30 +00:00
Lance Release 16a6b9ce8f Bump version: 0.14.1-beta.3 → 0.14.1-beta.4 v0.14.1-beta.4 2024-12-13 05:34:01 +00:00
Lance Release e3c6213333 Bump version: 0.17.1-beta.3 → 0.17.1-beta.4 python-v0.17.1-beta.4 2024-12-13 05:33:34 +00:00
Weston Pace 00552439d9 feat: upgrade lance to 0.21.0b3 (#1936) 2024-12-12 21:32:59 -08:00
QianZhu c0ee370f83 docs: improve schema evolution api examples (#1929) 2024-12-12 10:52:06 -08:00
QianZhu 17e4022045 docs: add faq to cloud doc (#1907)
Co-authored-by: Will Jones <willjones127@gmail.com>
2024-12-12 10:07:03 -08:00
BubbleCal c3ebac1a92 feat(node): support FTS options in nodejs (#1934)
Closes #1790

---------

Signed-off-by: BubbleCal <bubble-cal@outlook.com>
2024-12-12 08:19:04 -08:00
Lance Release 10f919a0a9 Updating package-lock.json 2024-12-11 19:18:36 +00:00
Lance Release 8af5476395 Bump version: 0.14.1-beta.2 → 0.14.1-beta.3 v0.14.1-beta.3 2024-12-11 19:18:17 +00:00
Lance Release bcbbeb7a00 Bump version: 0.17.1-beta.2 → 0.17.1-beta.3 python-v0.17.1-beta.3 2024-12-11 19:17:54 +00:00
Weston Pace d6c0f75078 feat: upgrade to lance prerelease 0.21.0b2 (#1933) 2024-12-11 11:17:10 -08:00
Lance Release e820e356a0 Updating package-lock.json 2024-12-11 17:58:05 +00:00
Lance Release 509286492f Bump version: 0.14.1-beta.1 → 0.14.1-beta.2 v0.14.1-beta.2 2024-12-11 17:57:41 +00:00
Lance Release f9789ec962 Bump version: 0.17.1-beta.1 → 0.17.1-beta.2 python-v0.17.1-beta.2 2024-12-11 17:57:18 +00:00
Lei Xu 347515aa51 fix: support list of numpy f16 floats as query vector (#1931)
User reported on Discord, when using
`table.vector_search([np.float16(1.0), np.float16(2.0), ...])`, it
yields `TypeError: 'numpy.float16' object is not iterable`
2024-12-10 16:17:28 -08:00
BubbleCal 3324e7d525 feat: support 4bit PQ (#1916) 2024-12-10 10:36:03 +08:00
Will Jones ab5316b4fa feat: support offset in remote client (#1923)
Closes https://github.com/lancedb/lancedb/issues/1876
2024-12-09 17:04:18 -08:00
Will Jones db125013fc docs: better formatting for Node API docs (#1892)
* Sets `"useCodeBlocks": true`
* Adds a post-processing script `nodejs/typedoc_post_process.js` that
puts the parameter description on the same line as the parameter name,
like it is in our Python docs. This makes the text hierarchy clearer in
those sections and also makes the sections shorter.
2024-12-09 17:04:09 -08:00
Will Jones a43193c99b fix(nodejs): upgrade arrow versions (#1924)
Closes #1626
2024-12-09 15:37:11 -08:00
Lance Release b70513ca72 Updating package-lock.json 2024-12-09 08:41:09 +00:00
Lance Release 78165801c6 Bump version: 0.14.1-beta.0 → 0.14.1-beta.1 v0.14.1-beta.1 2024-12-09 08:40:55 +00:00
Lance Release 6e5927ce6d Bump version: 0.17.1-beta.0 → 0.17.1-beta.1 python-v0.17.1-beta.1 2024-12-09 08:40:35 +00:00
BubbleCal 6c1f32ac11 fix: index params are ignored by RemoteTable (#1928)
Signed-off-by: BubbleCal <bubble-cal@outlook.com>
2024-12-09 16:37:01 +08:00
Lance Release 4fdf084777 Updating package-lock.json 2024-12-09 04:01:51 +00:00
Lance Release 1fad24fcd8 Bump version: 0.14.0 → 0.14.1-beta.0 v0.14.1-beta.0 2024-12-09 04:01:35 +00:00
Lance Release 6ef20b85ca Bump version: 0.17.0 → 0.17.1-beta.0 python-v0.17.1-beta.0 2024-12-09 04:01:19 +00:00
LuQQiu 35bacdd57e feat: support azure account name storage options in sync db.connect (#1926)
db.connect with azure storage account name is supported in async connect
but not sync connect.
Add this functionality

---------

Co-authored-by: Will Jones <willjones127@gmail.com>
2024-12-08 20:00:23 -08:00
Will Jones a5ebe5a6c4 fix: create_scalar_index in cloud (#1922)
Fixes #1920
2024-12-07 19:48:40 -08:00
Will Jones bf03ad1b4a ci: fix release (#1919)
* Set `private: false` so we can publish new binary packages
* Add missing windows binary reference
2024-12-06 12:51:48 -08:00
Bert 2a9e3e2084 feat(python): support hybrid search in async sdk (#1915)
fixes: https://github.com/lancedb/lancedb/issues/1765

---------

Co-authored-by: Will Jones <willjones127@gmail.com>
2024-12-06 13:53:15 -05:00
Lance Release f298f15360 Updating package-lock.json 2024-12-06 17:13:37 +00:00
Lance Release 679b031b99 Bump version: 0.14.0-beta.3 → 0.14.0 v0.14.0 2024-12-06 17:13:15 +00:00
Lance Release f50b5d532b Bump version: 0.14.0-beta.2 → 0.14.0-beta.3 2024-12-06 17:13:10 +00:00
Lance Release fe655a15f0 Bump version: 0.17.0-beta.4 → 0.17.0 python-v0.17.0 2024-12-06 17:12:43 +00:00
Lance Release 9d0af794d0 Bump version: 0.17.0-beta.3 → 0.17.0-beta.4 2024-12-06 17:12:43 +00:00
Will Jones 048a2d10f8 fix: data type parsing (#1918)
Fixes failing test on main
2024-12-06 08:56:07 -08:00
Lei Xu c78a9849b4 ci: upgrade version of upload-pages-artifact and deploy-pages (#1917)
For
https://github.blog/changelog/2024-12-05-deprecation-notice-github-pages-actions-to-require-artifacts-actions-v4-on-github-com/
2024-12-06 10:45:24 -05:00
BubbleCal c663085203 feat: support FTS options on RemoteTable (#1807) 2024-12-06 21:49:03 +08:00
Will Jones 8b628854d5 ci: fix nodejs release jobs (#1912)
* Clean up old commented out jobs
* Fix runner issue that caused these failures:
https://github.com/lancedb/lancedb/actions/runs/12186754094
2024-12-05 14:45:10 -08:00
Will Jones a8d8c17b2a docs(rust): fix doctests (#1913)
* One doctest was running for > 60 seconds in CI, since it was
(unsuccessfully) trying to connect to LanceDB Cloud.
* Fixed the example for `Query::full_text_query()`, which was incorrect.
2024-12-05 14:44:59 -08:00
Will Jones 3c487e5fc7 perf: re-use table instance during write (#1909)
Previously, whenever `Table.add()` was called, we would write and
re-open the underlying dataset. This was bad for performance, as it
reset the table cache and initiated a lot of IO. It also could be the
source of bugs, since we didn't necessarily pass all the necessary
connection options down when re-opening the table.

Closes #1655
2024-12-05 14:44:50 -08:00
Will Jones d6219d687c chore: simplify arrow json conversion (#1910)
Taking care of a small TODO
2024-12-05 13:14:43 -08:00
Bert 239f725b32 feat(python)!: async-sync feature parity on Connections (#1905)
Closes #1791
Closes #1764
Closes #1897 (Makes this unnecessary)

BREAKING CHANGE: when using azure connection string `az://...` the call
to connect will fail if the azure storage credentials are not set. this
is breaking from the previous behaviour where the call would fail after
connect, when user invokes methods on the connection.
2024-12-05 14:54:39 -05:00
Will Jones 5f261cf2d8 feat: upgrade to Lance v0.20.0 (#1908)
Upstream change log:
https://github.com/lancedb/lance/releases/tag/v0.20.0
2024-12-05 10:53:59 -08:00
Will Jones 79eaa52184 feat: schema evolution APIs in all SDKs (#1851)
* Support `add_columns`, `alter_columns`, `drop_columns` in Remote SDK
and async Python
* Add `data_type` parameter to node
* Docs updates
2024-12-04 14:47:50 -08:00
Lei Xu bd82e1f66d feat(python): add support for Azure OpenAPI SDK (#1906)
Closes #1699
2024-12-04 13:09:38 -08:00
Lance Release ba34c3bee1 Updating package-lock.json 2024-12-04 01:14:24 +00:00
Lance Release d4d0873e2b Bump version: 0.14.0-beta.1 → 0.14.0-beta.2 v0.14.0-beta.2 2024-12-04 01:13:55 +00:00
Lance Release 12c7bd18a5 Bump version: 0.17.0-beta.2 → 0.17.0-beta.3 python-v0.17.0-beta.3 2024-12-04 01:13:18 +00:00