allenai/

wcep_sparse_mean

This is a copy of the WCEP-10 dataset, except the input source documents of its test split have been replaced by a sparse retriever. The retrieval pipeline used:

query: The summary field of each example corpus: The union of all documents in the train, validation and test splits retriever: BM25 via PyTerrier with default settings top-k strategy: "mean", i.e. the number of documents retrieved, k, is set as the mean number of documents seen across examples in this dataset, in this case k==9… See the full description on the dataset page: https://huggingface.co/datasets/allenai/wcep_sparse_mean.