Views
No views yet
attn.o_proj, mlp.down_proj projections of layers 9-64, solved in closed form rather than by gradient descent.| Parameter | Value |
|---|---|
| start_layer_index | 9 |
| end_layer_index | 64 |
| overcorrect_relative_weight | 4.29079 |
| neighbor_count | 128 |
| rank | 3 |
| ridge | 1 |
| Metric | This model | Original model (Qwen/Qwen3.8-27B) |
|---|---|---|
| KL divergence | 0.0528 | 0 (by definition) |
| Refusals | 7/100 | 87/100 |
mlabonne/harmless_alpaca), and refusals are
counted over 100 harmful prompts
(mlabonne/harmful_behaviors, test[:100]).