49,289 of the 53,291 rows in
POLARIS-Project/Polaris-Dataset-53K,
with 4,580 stored answers corrected and 4,002 rows removed as unrepairable.
Measurements on the source set put its bad-label rate at roughly 15.9%
[14.3, 17.6] (two independent detectors agreeing on a 2,000-row sample).
Mislabelled rows are not uniformly distributed: they concentrate in the problems
models fail, which is exactly where a difficulty-calibration pipeline looks.… See the full description on the dataset page:
https://huggingface.co/datasets/joanvelja/polaris-53k-repaired.