Views
No views yet
[!TIP] This model is reproducible!See the README in thereproducedirectory for more information.
| Parameter | Value |
|---|---|
| direction_index | per layer |
| attn.o_proj.max_weight | 1.45 |
| attn.o_proj.max_weight_position | 51.65 |
| attn.o_proj.min_weight | 0.93 |
| attn.o_proj.min_weight_distance | 28.98 |
| mlp.down_proj.max_weight | 1.22 |
| mlp.down_proj.max_weight_position | 43.01 |
| mlp.down_proj.min_weight | 1.11 |
| mlp.down_proj.min_weight_distance | 5.21 |
| Metric | This model | Original model (bgg1996/Melinoe-Gemma4-31B-VL) |
|---|---|---|
| KL divergence | 0.0306 | 0 (by definition) |
| Refusals | 15/100 | 100/100 |
Gemma 4) and fine-tuning data. It may generate content that reinforces existing stereotypes.