Run ID: 20260724-swe_bench_verified_mini-openclaw-gemma-4-31b-it-v02
Benchmark: SWE-Bench Verified Mini
Agent/harness: openclaw via AlphaDiana Podman SWE harness
Model: google/gemma-4-31B-it
Slurm job: v02
Summary from local inspection:
50 task rows
49 valid_scored
1 runtime_error
0 provider_error
22 correct
finish reasons: none
valid-only accuracy: 0.4490
completed-row accuracy: 0.4400
total-denominator pass@1/accuracy: 0.4400… See the full description on the dataset page:
https://huggingface.co/datasets/n-pelleriti/alphadiana-swe-mini-openclaw-gemma4-20260724-k9q7.