Views
No views yet

| Category | CRACK ASR |
|---|---|
| Chemical / biological | 10/10 |
| Copyright | 10/10 |
| Cybercrime / intrusion | 10/10 |
| Harassment / bullying | 8/10 |
| Illegal | 8/10 |
| Misinformation / disinformation | 9/10 |
| General harmful | 9/10 |
| Overall | 64/70 (91%) |
| Subject area | base | CRACK | Δ |
|---|---|---|---|
| Overall | 82.5% | 84.2% | +1.7pp |
| STEM | 88.9% | 88.9% | +0.0pp |
| Humanities | 76.9% | 80.8% | +3.9pp |
| Social Sciences | 87.5% | 83.3% | -4.2pp |
| Other (medicine, business, …) | 75.0% | 82.1% | +7.1pp |
<think>; vMLX's reasoning parser surfaces the trace in message.reasoning_content and the final answer in message.content1# OpenAI-compatible chat completion
2# POST /v1/chat/completions
3{
4 "model": "dealignai/Step-3.7-Flash-JANG_2L-CRACK",
5 "messages": [{"role": "user", "content": "..."}],
6 "temperature": 0.6, "top_p": 0.95
7}