Views
No views yet
| Adapter | Training data | GPQA | Verdict |
|---|---|---|---|
| newton (untrained baseline) | — | 34.0% | reproduced to the decimal, 4 days apart |
| newton-star-r | 350 keep-correct + 180 rationalized | benchmark in progress | complete STaR method |
| newton-star-hard | 350 MMLU-Pro STEM keep-correct | 28.0% | attenuated the harm, below baseline |
| newton-star | 500 easy-science keep-correct | 25.0% | regressed to chance |
docs/CHANGELOG_2026-07-09.md, docs/CHANGELOG_2026-07-11.md).