OLMo-150M-as_fm3_tg_omi1_omi2
150M OLMo model pretrained on Algebraic Stack, FineMath3+, TinyGSM, OpenMathInstruct1, and OpenMathInstruct2.
Reading Model Names
Model names contain the contents of the pretraining dataset, delimited by underscores.
- as: Algebraic Stack
- fm3: FineMath3+
- tg: TinyGSM
- omi1: OpenMathInstruct1
- omi2: OpenMathInstruct2
If there is a {n}x in front of the dataset abbreviation, that means it was repeated n times during pretraining. For instance, 2xtg refers to two passes over the TinyGSM dataset.
