Views
No views yet
| 测评集 | 测评指标 | openPangu-2.0-Flash-Thinking | openPangu-2.0-Flash-Non-Thinking |
|---|---|---|---|
| 通用能力 | |||
| CL-Bench | Acc | 20.4 | 15.5 |
| IFEval | Prompt Strict | 95.9 | 89.3 |
| IFBench | Prompt Strict | 79.6 | 54.4 |
| AgentIF | (CSR+ISR)/2 | 44.9 | 43.9 |
| SysBench | ISR | 91.1 | 87.9 |
| Multichallenge | Acc | 68.4 | 51.9 |
| 推理能力 | |||
| AIME 2026 | Avg@16 | 93.3 | 86.5 |
| - w/ Python | Avg@16 | 98.1 | - |
| HMMT Feb 2025 | Avg@16 | 91.5 | 67.1 |
| - w/ Python | Avg@16 | 96.9 | - |
| IMO-AnswerBench | Acc | 76.5 | 62.3 |
| - w/ Python | Acc | 80.8 | - |
| BBEH | Harmonic Mean | 62.5 | 51.5 |
| GPQA-Diamond | Avg@4 | 83.7 | 79.8 |
| Agent能力 | |||
| BrowseComp | Acc | 57.0 | - |
| SkillsBench | Avg@5 | 42.6 | 40.0 |
| PinchBench | Avg@3 | 85.6 | 82.5 |
| Claw-Eval | Pass^3 | 57.7 | 58.2 |
| WildClawBench | Avg@3 | 41.5 | 35.0 |
| MCP-Atlas | Acc | 58.9 | 47.9 |
| TAU2-Bench | Avg@3 | 88.0 | 74.0 |
| 代码能力 | |||
| LiveCodeBench V6 | Avg@3 | 85.1 | 50.9 |
| DeepCodeBench | Avg@3 | 76.5 | 70.9 |
| SWE-bench Verified | Avg@3 | 63.1 | 57.6 |
| FeatBench | Avg@3 | 45.9 | 45.8 |