Dataset Card for "qm_grader_first_1.0e"
Dataset Summary
Quirky Math is a collection of datasets and models to benchmark Eliciting Latent Knowledge (ELK) methods.
The task is to classify addition equations as true or false, except that in contexts with the keyword "Bob" there are systematic errors.
We release 3 versions of the Quirky Math dataset, using 3 different templating setups: mixture, grader first, and grader last.
They are used to LoRA-finetune 24 "quirky" models… See the full description on the dataset page: https://huggingface.co/datasets/EleutherAI/qm-grader-first.
