Complete raw exports from running the public 600-task
AutomationBench (Zapier, v1.0.5, --toolset api)
on open-weight models served locally with SGLang 0.5.12 on 8x H200.
Each .json.gz is the untouched --export-json output: run metadata, summary, and one record per
task including every message of the trajectory, the final environment state, and per-assertion
results.
File
Model
Pass rate
Partial credit… See the full description on the dataset page:
https://huggingface.co/datasets/beyoru/automationbench600-open-weight-runs.
