irds/

trec-arabic

The trec-arabic dataset, provided by the ir-datasets package. For more information about the dataset, see the documentation.

This dataset provides:

docs (documents, i.e., the corpus); count=383,872

This dataset is used by: trec-arabic_ar2001, trec-arabic_ar2002

from datasets import load_dataset

docs = load_dataset('irds/trec-arabic', 'docs') for record in docs: record # {'doc_id': ..., 'text': ..., 'marked_up_doc':… See the full description on the dataset page: https://huggingface.co/datasets/irds/trec-arabic.