Created using Colaboratory

updated requirements txt to use faiss cpu
2024-04-04 14:38:48 +02:00 · 2024-04-04 11:22:38 +00:00 · 2024-04-04 13:20:46 +02:00 · 2024-04-04 10:47:54 +00:00 · 2024-04-04 10:38:12 +00:00
6 changed files with 1666 additions and 953 deletions
--- a/EverNote_Documents_To_FAISS_Colab_GPU.ipynb
+++ b/EverNote_Documents_To_FAISS_Colab_GPU.ipynb
--- a/EverNote_To_OpenAI.ipynb
+++ b/EverNote_To_OpenAI.ipynb
--- a/data/export.documents.txt
+++ b/data/export.documents.txt
--- a/data/export.txt
+++ b/data/export.txt
--- a/requirements.gpu.txt
+++ b/requirements.gpu.txt
@ -0,0 +1,23 @@
+openai==1.13.3
+langchain==0.1.10
+pinecone-client==3.1.0
+python-dotenv==1.0.1
+tiktoken==0.6.0
+wikipedia==1.4.0
+pypdf[full]==4.0.2
+langchain_openai==0.0.8
+langchain_experimental==0.0.53
+langchainhub==0.1.14
+ipywidgets
+cryptography==42.0.5
+pikepdf==8.13.0
+html2text==2024.2.26
+transformers==4.39.0
+torch
+torchvision
+torchaudio
+sentence-transformers==2.5.1
+sqlite-vss==0.1.2
+faiss_cpu==1.8.0
+
+
--- a/requirements.txt
+++ b/requirements.txt
@ -8,14 +8,16 @@ pypdf[full]==4.0.2
 langchain_openai==0.0.8
 langchain_experimental==0.0.53
 langchainhub==0.1.14
-ipywidgets==8.1.2
+ipywidgets
 cryptography==42.0.5
 pikepdf==8.13.0
+html2text==2024.2.26
 transformers==4.39.0
 torch==2.2.1+cpu
 torchvision==0.17.1+cpu
 torchaudio==2.2.1+cpu
 sentence-transformers==2.5.1
 sqlite-vss==0.1.2
+faiss_cpu==1.8.0
Author	SHA1	Message	Date
Marius Ciepluch	30ebb519a1	Created using Colaboratory	2024-04-04 14:38:48 +02:00
Marius Ciepluch	c422d14692	updated requirements txt to use faiss cpu	2024-04-04 11:22:38 +00:00
Marius Ciepluch	6fd67189d1	Created using Colaboratory	2024-04-04 13:20:46 +02:00
Marius Ciepluch	2d7e889968	requirements gpu txt	2024-04-04 10:47:54 +00:00
Marius Ciepluch	e56c87a71d	moved from sqlite to faiss for concurrency reasons	2024-04-04 10:38:12 +00:00