irds/

wikiclir_ja

The wikiclir/ja dataset, provided by the ir-datasets package. For more information about the dataset, see the documentation.

This dataset provides:

docs (documents, i.e., the corpus); count=1,071,292 queries (i.e., topics); count=426,431 qrels: (relevance assessments); count=3,338,667

from datasets import load_dataset

docs = load_dataset('irds/wikiclir_ja', 'docs') for record in docs: record # {'doc_id': ...… See the full description on the dataset page: https://huggingface.co/datasets/irds/wikiclir_ja.