Views
No views yet
pip install transformers==4.35.0
pip install torch==2.0.1
pip install sentencepiece==0.1.99
pip install tokenizers==0.13.3
pip install accelerate==0.21.0
pip install bitsandbytes==0.40.0
pip install vllm
pip install fraction
pip install protobuf| Model | GSM8k Pass@1 | MATH Pass@1 |
|---|---|---|
| MetaMath-7B | 66.5 | 19.8 |
| MetaMath-13B | 72.3 | 22.4 |
| MetaMath-70B | 82.3 | 26.6 |
| MetaMath-Llemma-7B | 69.2 | 30.0 |
| MetaMath-Mistral-7B | 77.7 | 28.2 |
| 🔥 metamath-llemma-34B | 76.1 | 31.4 |