18 Commits

Author	SHA1	Message	Date
Ayush Chaurasia	0b9924b432	Make creating (and adding to) tables via Iterators more flexible & intuitive (#430) ... It improves the UX as iterators can be of any type supported by the table (plus recordbatch) & there is no separate requirement. Also expands the test cases for pydantic & arrow schema. If this is looks good I'll update the docs. Example usage: ``` class Content(LanceModel): vector: vector(2) item: str price: float def make_batches(): for _ in range(5): yield from [ # pandas pd.DataFrame({ "vector": [[3.1, 4.1], [1, 1]], "item": ["foo", "bar"], "price": [10.0, 20.0], }), # pylist [ {"vector": [3.1, 4.1], "item": "foo", "price": 10.0}, {"vector": [5.9, 26.5], "item": "bar", "price": 20.0}, ], # recordbatch pa.RecordBatch.from_arrays( [ pa.array([[3.1, 4.1], [5.9, 26.5]], pa.list_(pa.float32(), 2)), pa.array(["foo", "bar"]), pa.array([10.0, 20.0]), ], ["vector", "item", "price"], ), # pydantic list [ Content(vector=[3.1, 4.1], item="foo", price=10.0), Content(vector=[5.9, 26.5], item="bar", price=20.0), ]] db = lancedb.connect("db") tbl = db.create_table("tabley", make_batches(), schema=Content, mode="overwrite") tbl.add(make_batches()) ``` Same should with arrow schema. --------- Co-authored-by: Weston Pace <weston.pace@gmail.com>	2023-08-18 09:56:30 +05:30
Ashis Kumar Naik	902a402951	implementation of drop_database (#418) ... #416 Fixed. added drop_database() method . This deletes all the tables from the database with a single command. --------- Signed-off-by: Ashis Kumar Naik <ashishami2002@gmail.com>	2023-08-11 20:59:56 -07:00
Chang She	a54d1e5618	Automatically convert pydantic model (#400) ... Saves users from having to explicitly call `LanceModel.to_arrow_schema()` when creating an empty table. See new docs for full details. --------- Co-authored-by: Chang She <chang@lancedb.com>	2023-08-06 14:50:03 -07:00
Ayush Chaurasia	bbfadfe58d	[python] Allow adding via iterators (#391) ... Makes the following work so all the formats accepted by `create_table()` are also accepted by `add()` ``` import lancedb import pyarrow as pa db = lancedb.connect("/tmp") def make_batches(): for i in range(5): yield pa.RecordBatch.from_arrays( [ pa.array([[3.1, 4.1], [5.9, 26.5]]), pa.array(["foo", "bar"]), pa.array([10.0, 20.0]), ], ["vector", "item", "price"], ) schema = pa.schema([ pa.field("vector", pa.list_(pa.float32())), pa.field("item", pa.utf8()), pa.field("price", pa.float32()), ]) tbl = db.create_table("table4", make_batches(), schema=schema) tbl.add(make_batches()) ```	2023-08-04 12:49:44 -07:00
Chang She	2d25c263e9	Implement drop table if exists (#383)	2023-07-31 10:25:09 +02:00
Lei Xu	088e745e1d	[Python] Create table with Iterator[RecordBatch] and add docs (#316)	2023-07-16 21:45:55 -07:00
Chang She	2fdcb307eb	[python] Fix a few minor bugs (#304)	2023-07-15 03:47:42 +08:00
Leon Yee	eb5bcda337	Error implementations (#232) ... Solves #216 by adding a check on table open for existence of the `.lance` file. Does not check for it for remote connections.	2023-06-27 16:48:31 -07:00
Lei Xu	4bc676e26a	[Python] Support replace during create_index (#233) ... Closes #214	2023-06-27 16:02:07 -07:00
Tevin Wang	9b83ce3d2a	add black to python CI (#178) ... Closes #48	2023-06-12 11:22:34 -07:00
Lei Xu	9965b4564d	[Python] Support drop table (#123) ... Closes #86	2023-06-01 15:58:45 -07:00
Chang She	59014a01e0	bump version for v0.1.2	2023-05-05 11:27:09 -07:00
Chang She	d7c5793803	Add mode to overwrite table if already exists	2023-04-19 16:22:11 -07:00
Lei Xu	c38d80cab2	remove print	2023-04-19 14:26:07 -07:00
Lei Xu	b3fdabdf45	use python and arrow	2023-04-19 14:15:18 -07:00
Chang She	5ef5141812	black	2023-03-22 18:29:07 -07:00
Chang She	690141d357	add unit tests	2023-03-21 22:29:19 -07:00
Chang She	b10301f5d6	initial python impl	2023-03-18 10:43:26 -07:00