This repository contains the data-only portion of the Center for Open Science (COS) LLM Benchmarking Project. The dataset supports benchmarking LLM agents on core parts of the scientific research lifecycle—especially replication—including:
Information extraction from scientific papers into structured JSON
Research design and analysis planning
(Optional) execution support using provided replication datasets… See the full description on the dataset page:
https://huggingface.co/datasets/domsoos/replicatorbench.
