Views
No views yet
| SmolLM2-1.7B-Instruct-Heretic | Original model SmolLM2-1.7B-Instruct | |
|---|---|---|
| Refusals | 5/100 | 37/100 |
| KL divergence | 0.0523 | 0 (by definition) |
| Parameter | Value |
|---|---|
| direction_index | 18.34 |
| attn.o_proj.max_weight | 0.81 |
| attn.o_proj.max_weight_position | 14.52 |
| attn.o_proj.min_weight | 0.56 |
| attn.o_proj.min_weight_distance | 8.50 |
| mlp.down_proj.max_weight | 1.14 |
| mlp.down_proj.max_weight_position | 17.18 |
| mlp.down_proj.min_weight | 0.93 |
| mlp.down_proj.min_weight_distance | 7.16 |