Views
No views yet
| greedy | majority@50 | |||
| model | GSM8K | MATH | GMS8K | MATH |
| OpenMath-CodeLlama-7B (nemo | HF) | 75.9 | 43.6 | 84.8 | 55.6 |
| OpenMath-Mistral-7B (nemo | HF) | 80.2 | 44.5 | 86.9 | 57.2 |
| OpenMath-CodeLlama-13B (nemo | HF) | 78.8 | 45.5 | 86.8 | 57.6 |
| OpenMath-CodeLlama-34B (nemo | HF) | 80.7 | 48.3 | 88.0 | 60.2 |
| OpenMath-Llama2-70B (nemo | HF) | 84.7 | 46.3 | 90.1 | 58.3 |
| OpenMath-CodeLlama-70B (nemo | HF) | 84.6 | 50.7 | 90.8 | 60.4 |
1@article{toshniwal2024openmath,
2 title = {OpenMathInstruct-1: A 1.8 Million Math Instruction Tuning Dataset},
3 author = {Shubham Toshniwal and Ivan Moshkov and Sean Narenthiran and Daria Gitman and Fei Jia and Igor Gitman},
4 year = {2024},
5 journal = {arXiv preprint arXiv: Arxiv-2402.10176}
6}