stanford-oval/

wikipedia_20240401_10-languages_bge-m3_qdrant_index

This repository contains a Qdrant index created from preprocessed and chunked Wikipedia HTML dumps from 10 languages. The embedding model used is BAAI/bge-m3 This index is compatible with WikiChat v2.0. Refer to the following for more information: GitHub repository: https://github.com/stanford-oval/WikiChat Papers:

WikiChat: Stopping the Hallucination of Large Language Model Chatbots by Few-Shot Grounding on Wikipedia SPAGHETTI: Open-Domain Question Answering from Heterogeneous Data Sources… See the full description on the dataset page: https://huggingface.co/datasets/stanford-oval/wikipedia_20240401_10-languages_bge-m3_qdrant_index.