CosmoPaperQA is an evaluation dataset, designed to serve as a benchmark for RAG applications with cosmology papers, with an emphasis on testing for fetching, interprative and explanatory skills.
The information sources for the questions and ideal answers are these 5 papers:
Planck Collaboration, Planck 2018 results. VI. Cosmological parameters, Astron.Astrophys. 641 (2020) A6
Villaescusa-Navarro et al., The CAMELS project: Cosmology and Astrophysics with MachinE Learning Simulations… See the full description on the dataset page:
https://huggingface.co/datasets/ASTROANTS/CosmoPaperQA.
