kth8/

gemma-4-E4B-it-ValleyBench-benchmark

Benchmark of google/gemma-4-E4B-it against kth8/ValleyBench dataset. Model's answer is considered correct if it is within 0.01 of ground answer. Accuracy: 80.3% with Python tool.

Metric Value

Correct 4014

Incorrect 958

Errors 28

Total samples 5000

Python tool calls 4843

Total completion tokens 4,595,312

Raw stats: { "accuracy": 0.803, "correct": 4014, "incorrect": 958, "error": 28, "total": 5000, "python_tool_calls": 4843, "completion_tokens": 4595312 }