rust/lancedb
1
0
Fork 0
mirror of https://github.com/lancedb/lancedb.git synced 2025-12-25 06:19:57 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,045 Commits 116 Branches 395 Tags
lu/python-0.9.0
Commit Graph

377 Commits

Author SHA1 Message Date
Will Jones
6d76fe80b8 chore: upgrade lance to v0.8.17 (#656) 
Readying for the next Lance release.
 2024-04-05 16:23:49 -07:00
Rok Mihevc
78ab9068a8 feat(python): expose index cache size (#655) 
This is to enable https://github.com/lancedb/lancedb/issues/641.
Should be merged after https://github.com/lancedb/lance/pull/1587 is
released.
 2024-04-05 16:23:49 -07:00
Aidan
775bee576c SaaS create_index API (#649) 2024-04-05 16:23:49 -07:00
Rok Mihevc
32cb1b9ea4 feat: add RemoteTable.version in Python (#644) 
Please note: this is not tested as we don't have a server here and
testing against a mock object wouldn't be that interesting.
 2024-04-05 16:23:49 -07:00
Ayush Chaurasia
d59dbf8230 fix: Pydantic 1.x compat for weak_lru caching in embeddings API (#643) 
Colab has pydantic 1.x by default and pydantic 1.x BaseModel objects
don't support weakref creation by default that we use to cache embedding
models
https://github.com/lancedb/lancedb/blob/main/python/lancedb/embeddings/utils.py#L206
. It needs to be added to slot.
 2024-04-05 16:23:49 -07:00
Ayush Chaurasia
c0a49a9a5b Multi-task instructor model with quantization support & weak_lru cache for embedding function models (#612) 
resolves #608
 2024-04-05 16:23:49 -07:00
QianZhu
2f2964a645 fix saas open_table and table_names issues (#640) 
- added check whether a table exists in SaaS open_table
- remove prefilter not supported warning in SaaS search
- fixed issues for SaaS table_names
 2024-04-05 16:23:49 -07:00
Lei Xu
86efd36689 chore: improve create_table API consistency between local and remote SDK (#627) 2024-04-05 16:23:47 -07:00
Ayush Chaurasia
159ecbac5a Exponential standoff retry support for handling rate limited embedding functions (#614) 
Users ingesting data using rate limited apis don't need to manually make
the process sleep for counter rate limits
resolves #579
 2024-04-05 16:23:14 -07:00
Lance Release
c1b037f0a5 [python] Bump version: 0.3.2 → 0.3.3 2024-04-05 16:23:14 -07:00
Lei Xu
3855bdf986 chore: bump lance to 8.10 (#622) 2024-04-05 16:23:14 -07:00
Bert
cd7a4dd251 fix!: sort table names (#619) 
https://github.com/lancedb/lance/issues/1385
 2024-04-05 16:22:59 -07:00
QianZhu
3c139c2ee5 Qian/query option doc (#615) 
- API documentation improvement for queries (table.search)
- a small bug fix for the remote API on create_table

![image](https://github.com/lancedb/lancedb/assets/1305083/712e9bd3-deb8-4d81-8cd0-d8e98ef68f4e)

![image](https://github.com/lancedb/lancedb/assets/1305083/ba22125a-8c36-4e34-a07f-e39f0136e62c)
 2024-04-05 16:22:59 -07:00
Will Jones
166b281d66 increment pylance (#618) 2024-04-05 16:22:59 -07:00
Bert
c9fee0faed added api docs for prefilter flag (#617) 
Added the prefilter flag argument to the `LanceQueryBuilder.where`.

This should make it display here:

https://lancedb.github.io/lancedb/python/python/#lancedb.query.LanceQueryBuilder.select

And also in intellisense like this:
<img width="848" alt="image"
src="https://github.com/lancedb/lancedb/assets/5846846/e0c53f4f-96bc-411b-9159-680a6c4d0070">

Also adds some improved documentation about the `where` argument to this
method.

---------

Co-authored-by: Weston Pace <weston.pace@gmail.com>
 2024-04-05 16:22:59 -07:00
Weston Pace
301e08f30e feat: allow prefiltering with index (#610) 
Support for prefiltering with an index was added in lance version 0.8.7.
We can remove the lancedb check that prevents this. Closes #261
 2024-04-05 16:22:59 -07:00
Lance Release
a3c955070e [python] Bump version: 0.3.1 → 0.3.2 2024-04-05 16:22:59 -07:00
Bert
edeecd3d9f update lance to 0.8.7 (#598) 2024-04-05 16:22:59 -07:00
Chang She
2861f33982 fix(python): fix multiple embedding functions bug (#597) 
Closes #594

The embedding functions are pydantic models so multiple instances with
the same parameters are considered ==, which means that if you have
multiple embedding columns it's possible for the embeddings to get
overwritten. Instead we use `is` instead of == to avoid this problem.

testing: modified unit test to include this case
 2024-04-05 16:22:59 -07:00
Will Jones
e37a0566e0 Revert "[python] Bump version: 0.3.2 → 0.3.3" 
This reverts commit c30faf6083.
 2024-04-05 16:22:59 -07:00
Will Jones
48999ffc27 [python] Bump version: 0.3.2 → 0.3.3 2024-04-05 16:22:59 -07:00
Chang She
31334b05df chore: bump lance version in python/rust lancedb (#584) 
To include latest v0.8.6

Co-authored-by: Chang She <chang@lancedb.com>
 2024-04-05 16:22:59 -07:00
Ayush Chaurasia
507f6087c2 [Python]Embeddings API refactor (#580) 
Sets things up for this -> https://github.com/lancedb/lancedb/issues/579
- Just separates out the registry/ingestion code from the function
implementation code
- adds a `get_registry` util
- package name "open-clip" -> "open-clip-torch"
 2024-04-05 16:22:59 -07:00
QianZhu
6b0d1d6ec1 list table pagination draft (#574) 2024-04-05 16:22:59 -07:00
Prashanth Rao
d38e3d496f Add pyarrow date and timestamp type conversion from pydantic (#576) 2024-04-05 16:22:59 -07:00
Lei Xu
8dc10180b0 feat(python,js): deletion operation on remote tables (#568) 2024-04-05 16:22:59 -07:00
Rok Mihevc
377a564904 docs: switch python examples to be row based (#554) 2024-04-05 16:22:59 -07:00
Lei Xu
7b5bfadab2 chore: bump lance to 0.8.5 (#561) 
Bump lance to 0.5.8
 2024-04-05 16:22:59 -07:00
Ayush Chaurasia
1c42894918 [DOCS][PYTHON] Update embeddings API docs & Example (#516) 
This PR adds an overview of embeddings docs:
- 2 ways to vectorize your data using lancedb - explicit & implicit
- explicit - manually vectorize your data using `wit_embedding` function
- Implicit - automatically vectorize your data as it comes by ingesting
your embedding function details as table metadata
- Multi-modal example w/ disappearing embedding function
 2024-04-05 16:22:59 -07:00
Lance Release
87c69e74fc [python] Bump version: 0.3.0 → 0.3.1 2024-04-05 16:22:59 -07:00
Ayush Chaurasia
0e9a7f0dc7 Add cohere embedding function (#550) 2024-04-05 16:22:59 -07:00
Will Jones
c07207c661 feat: cleanup and compaction (#518) 
#488
 2024-04-05 16:22:59 -07:00
Chang She
8469d010f8 feat: add to_list and to_pandas api's (#556) 
Add `to_list` to return query results as list of python dict (so we're
not too pandas-centric). Closes #555

Add `to_pandas` API and add deprecation warning on `to_df`. Closes #545

Co-authored-by: Chang She <chang@lancedb.com>
 2024-04-05 16:22:59 -07:00
Lei Xu
a26c8f3316 feat: use GPU for index creation. (#540) 
Bump lance to 0.8.3 to include GPU training

---------

Co-authored-by: Rob Meng <rob.xu.meng@gmail.com>
 2023-10-05 20:49:00 -07:00
Lance Release
a022368426 [python] Bump version: 0.2.6 → 0.3.0 2023-10-03 21:48:22 +00:00
Lei Xu
8b815ef5a8 chore: upgrade lance to 0.8.1 (#536) 
Bump to lance 0.8.1 for both javascript and python sdk
 2023-10-03 14:29:18 -07:00
Lance Release
d326146a40 [python] Bump version: 0.2.5 → 0.2.6 2023-10-01 17:48:59 +00:00
Chang She
693bca1eba feat(python): expose prefilter to lancedb (#522) 
We have experimental support for prefiltering (without ANN) in pylance.
This means that we can now apply a filter BEFORE vector search is
performed. This can be done via the `.where(filter_string,
prefilter=True)` kwargs of the query.

Limitations:
- When connecting to LanceDB cloud, `prefilter=True` will raise
NotImplemented
- When an ANN index is present, `prefilter=True` will raise
NotImplemented
- This option is not available for full text search query
- This option is not available for empty search query (just
filter/project)

Additional changes in this PR:
- Bump pylance version to v0.8.0 which supports the experimental
prefiltering.

---------

Co-authored-by: Chang She <chang@lancedb.com>
 2023-10-01 10:34:12 -07:00
Will Jones
343e274ea5 fix: define minimum dependency versions (#515) 
Closes #513

For each of these, I found the minimum version that would allow the unit
tests to pass.
 2023-09-29 09:04:49 -07:00
Rob Meng
a695fb8030 fix import attr to use import attrs (#510) 
Thanks to #508, I used `attr` instead of the correct package `attrs`

s/attr/attrs
 2023-09-23 00:30:56 -04:00
Hynek Schlawack
bc8670d7af [Python] Fix attrs dependency (#508) 
The `attr` project is unrelated to `attrs` that also provides the `attr`
namespace (see also <https://hynek.me/articles/import-attrs/>).

It used to _usually_ work, because attrs is a dependency of aiohttp and
somehow took precedence over `attr`'s `attr`.

Yes, sorry, it's a mess.
 2023-09-21 12:35:34 -04:00
Lance Release
74004161ff [python] Bump version: 0.2.4 → 0.2.5 2023-09-19 16:43:06 +00:00
Chang She
f20f19b804 feat: improve pydantic 1.x compat (#503) 2023-09-18 19:01:30 -07:00
Chang She
55207ce844 feat: add lancedb.__version__ (#504) 2023-09-18 18:51:51 -07:00
Chang She
c21f9cdda0 ci: fix docs build (#496) 
python/python.md contains typos in the class references

---------

Co-authored-by: Chang She <chang@lancedb.com>
 2023-09-18 13:07:21 -07:00
Chang She
31dad71c94 multi-modal embedding-function (#484) 2023-09-16 21:23:51 -04:00
Will Jones
9585f550b3 fix: increase S3 timeouts (#494) 
Closes #493
 2023-09-15 20:21:34 -07:00
Lance Release
8dc2315479 [python] Bump version: 0.2.3 → 0.2.4 2023-09-15 14:23:26 +00:00
Rob Meng
f6bfb5da11 chore: upgrade lance to 0.7.4 (#491) 2023-09-14 16:02:23 -04:00
Lance Release
661fcecf38 [python] Bump version: 0.2.2 → 0.2.3 2023-09-14 17:48:32 +00:00