Benchmark of openai/gpt-oss-20b against m-a-p/SuperGPQA dataset.
Accuracy: 44.9% with Python tool.
Metric
Value
Correct
898
Incorrect
1098
Errors
4
Total samples
2000
Python tool calls
2084
Python tool errors
117
Total completion tokens
3,829,112
Raw stats:
{
"accuracy": 0.449,
"correct": 898,
"incorrect": 1098,
"error": 4,
"total": 2000,
"python_tool_calls": 2084,
"python_tool_errors": 117,
"completion_tokens": 3829112
}
