Views
No views yet
[!TIP] This model is reproducible!See the README in thereproducedirectory for more information.
| Parameter | Value |
|---|---|
| direction_index | 41.77 |
| attn.o_proj.max_weight | 1.22 |
| attn.o_proj.max_weight_position | 51.32 |
| attn.o_proj.min_weight | 1.21 |
| attn.o_proj.min_weight_distance | 32.79 |
| mlp.down_proj.max_weight | 1.44 |
| mlp.down_proj.max_weight_position | 42.02 |
| mlp.down_proj.min_weight | 0.13 |
| mlp.down_proj.min_weight_distance | 37.15 |
| Metric | This model | Original model (TeichAI/Qwen3.6-27B-Claude-Opus-Reasoning-Distill-v2) |
|---|---|---|
| KL divergence | 0.0774 | 0 (by definition) |
| Refusals | 8/100 | 98/100 |

Qwen3.6-27B-Claude-Opus-Reasoning-Distill-v2
arc arc/e boolq hswag obkqa piqa wino
mxfp8 0.665,0.831,0.910,0.790,0.456,0.813,0.772
Qwen3.6-27B
arc arc/e boolq hswag obkqa piqa wino
mxfp8 0.647,0.803,0.910,0.773,0.450,0.806,0.742