Qwen3.5-9B tau2-bench Telecom Traces (Judged)
Dataset
Execution traces from Qwen3.5-9B on tau2-bench telecom domain.
Model: Qwen3.5-9B with thinking mode (temperature=0.6, top_p=0.95)
Domain: Telecom customer service (MMS, mobile data, service issues)
Traces: 1,625 total
Oracle reward: 442 pass (27.2%), 1,183 fail
Judge scores: 1,321 traces scored by GPT-5.4 (v2 rubric, 3 dimensions)
max_steps: 50