Verified bug-fix records for evaluating coding agents.
Every record is a real bug in public software, the fix its author wrote, and the
test that fails before the fix and passes after it. A record is kept only once
both runs have been observed, so what is published is a reproduction rather than
a claim.
896 records from 352 projects, all Python, with
fixes committed between 2010-06-13 and 2026-08-17.
Website · Code and verifier · Datasheet
from… See the full description on the dataset page:
https://huggingface.co/datasets/goldsetdev/goldset.