To train WideSeek-R1 efficiently, we deployed a suite of local search tools that the model can use during training.
This repository includes three components:
wiki_corpus.jsonl: Serves as the model’s Search tool. Given a query, it returns the most relevant snippets.
wiki_webpages.jsonl: Serves as the model’s Access tool. Given a specific URL, it returns the full webpage content.
qdrant/: A local Qdrant vector database built by embedding wiki_corpus.jsonl. It… See the full description on the dataset page:
https://huggingface.co/datasets/WideSeek-R1/Wiki-2018-Corpus.
