irds/

neuclir_1_zh

The neuclir/1/zh dataset, provided by the ir-datasets package. For more information about the dataset, see the documentation.

This dataset provides:

docs (documents, i.e., the corpus); count=3,179,209

from datasets import load_dataset

docs = load_dataset('irds/neuclir_1_zh', 'docs') for record in docs: record # {'doc_id': ..., 'title': ..., 'text': ..., 'url': ..., 'time': ..., 'cc_file': ...}

Note that calling… See the full description on the dataset page: https://huggingface.co/datasets/irds/neuclir_1_zh.