Four synthetic pretraining corpora crossing domain (grade-school math,
general Q&A) with register (pirate, plain), built from the two corpora in
jkminder/pretraining-priors-pirate-register.
gsm8k_pirate_ask
question + an instruction to answer as a pirate
pirate worked solution
347,136
gsm8k_plain
the same question, no instruction
the same solution in plain English… See the full description on the dataset page:
https://huggingface.co/datasets/Eugleo/pretraining-priors-pirate-2x2.
