Views
No views yet
| Model(1.5B) | AIME24 | AIME25 |
|---|---|---|
| Mobile-ReasoningLLM-v0-1.5B | 60.0 | 45.0 |
| Mobile-Flash-ReasoningLLM-v0-1.5B | 70.0 | 60.0 |
| Viber-Thinker-1.5B | 78.0 | 70.0 |
| Mobile-Flash-v1-1.5B | 90.0 | 80.0 |
| Model(>235B) | AIME24 | AIME25 |
| GPT-5.2 | 97.0+ | 97.0+ |
| Grok-4 | 97.0+ | 97.0+ |
| Gemini-3-Pro | 97.0+ | 97.0+ |
| GPT-OSS-120B | 96.6 | 97.9 |
| GPT-OSS-20B | 96.0 | 98.7 |
| Grok 3 Mini | 95.8 | 93.3 |
| o4-mini | 93.4 | 92.7 |
| o3 | 91.6 | 86.5 |
| DeepSeek-R1-0528(671B) | 91.4 | 87.5 |
| Qwen-3(235B) | 85.7 | 81.5 |
transformers, torch, vLLM or TensorRT-LLMhug environment)1import transformers
2import torch
3model_id = "deepgo/Mobile-Flash-v1.5-1.5B"
4pipeline = transformers.pipeline(
5 "text-generation",
6 model=model_id,
7 model_kwargs={"torch_dtype": torch.bfloat16},
8 device_map="auto",
9)
10# Math problem prompt
11prompt = """Solve the following math problem. Make sure to put the answer (and only answer) inside \\boxed{}."""
12max-length=40,000 is recommend.(reduced from 48,000 to 40,000)