Run ID: 20260724-swe_bench_verified_mini-zeroclaw-gemma-4-31b-it-v02
Benchmark: SWE-Bench Verified Mini
Agent/harness: zeroclaw via AlphaDiana Podman SWE harness
Model: google/gemma-4-31B-it
Slurm job: v02
Summary from local inspection:
50 task rows
46 valid_scored
4 runtime_error
0 provider_error
22 correct
finish reasons: none
valid-only accuracy: 0.4783
completed-row accuracy: 0.4400
total-denominator pass@1/accuracy: 0.4400… See the full description on the dataset page:
https://huggingface.co/datasets/n-pelleriti/alphadiana-swe-mini-zeroclaw-gemma4-20260724-r6m2.
