add simple langchain example

This commit is contained in:
Jai Chopra
2023-04-26 14:44:20 -07:00
parent 3d3ba913ed
commit ca8d8e82b7

View File

@@ -0,0 +1,15 @@
# Lance + LangChain on Pandas 2.0
## simple Pandas 2.0 documentation Q&A answering bot using LangChain
To demonstrate using Lance, were going to build a simple Q&A answering bot using LangChain — an open-source framework that allows you to build composable LLM-based applications easily. Well use chat-langchain, a simple Q&A answering bot app as an example. Note: in this fork of chat-langchain, were also using a forked version of LangChain integration where weve built a Lance integration.
The first step is to generate embeddings. You could build a bot using your own data, like a wiki page or internal documentation. For this example, were going to use the Pandas API documentation. LangChain offers document loaders to read and pre-process many document types. Since the Pandas API is in HTML, reading the docs is straightforward:
```python
for p in Path("./pandas.documentation").rglob("*.html"):
if p.is_dir():
continue
loader = UnstructuredHTMLLoader(p)
raw_document = loader.load()
docs = docs + raw_document