irds/

beir_nfcorpus

The beir/nfcorpus dataset, provided by the ir-datasets package. For more information about the dataset, see the documentation.

This dataset provides:

docs (documents, i.e., the corpus); count=3,633 queries (i.e., topics); count=3,237

This dataset is used by: beir_nfcorpus_dev, beir_nfcorpus_test, beir_nfcorpus_train

from datasets import load_dataset

docs = load_dataset('irds/beir_nfcorpus', 'docs') for record in… See the full description on the dataset page: https://huggingface.co/datasets/irds/beir_nfcorpus.