This repository contains the index files required for the SearchWikipediaTool of the bot-with-plan project.
It is based on the krasserm/wikipedia-2023-11-en-embed-mxbai-int8-binary dataset and contains the following files:
faiss-ubinary.index: Faiss index file containing the binary embeddings
usearch-int8-index: usearch index files containing the int8 embeddings
document-url-mappings.sqlite: SQLite database file containing mappings from document URLs to text chunk indices
The following code… See the full description on the dataset page:
https://huggingface.co/datasets/krasserm/wikipedia-2023-11-en-index.