Views
No views yet
| Parameter | Value |
|---|---|
| direction_index | per layer |
| attn.o_proj.max_weight | 1.49 |
| attn.o_proj.max_weight_position | 22.84 |
| attn.o_proj.min_weight | 1.49 |
| attn.o_proj.min_weight_distance | 20.26 |
| Metric | This model | Original model (axolotl-ai-co/Mistral-Small-4-119B-2603-BF16) |
|---|---|---|
| KL divergence | 0.0167 | 0 (by definition) |
| Refusals | 27/100 | 98/100 |