Views
No views yet
| Score Metric | Value | Parameter | Value |
|---|---|---|---|
| Refusals | 4/100 | direction_index | 23.52 |
| KL Divergence | 0.0307 | attn.o_proj.max_weight | 1.96 |
| Initial Refusals | 62/100 | attn.o_proj.max_weight_position | 32.76 |
| attn.o_proj.min_weight | 0.31 | ||
| attn.o_proj.min_weight_distance | 18.25 | ||
| mlp.down_proj.max_weight | 1.23 | ||
| mlp.down_proj.max_weight_position | 27.53 | ||
| mlp.down_proj.min_weight | 0.84 | ||
| mlp.down_proj.min_weight_distance | 19.87 |
| Index Entry | Classification | Analysis |
|---|---|---|
| Absolute Heresy | Less than 10/100 Refusals and 0.10 KL Divergence | |
| Tainted Heresy | Around 25-11/100 Refusals and/or -0.20-0.11 KL Divergence | |
| Impotent Heresy | Anything above 25/100 Refusals and 0.21 KL Divergence |
1models:
2 - model: anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-Text-Only
3
4 - model: TheDrummer/Magidonia-24B-v4.3
5 parameters:
6 density: 1.0
7 weight: 1.0
8 - model: TheDrummer/Precog-24B-v1
9 parameters:
10 density: 0.4
11 weight: 0.6
12 - model: zerofata/MS3.2-PaintedFantasy-v3-24B
13 parameters:
14 density: 0.4
15 weight: 0.4
16
17merge_method: ties
18base_model: anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-Text-Only
19parameters:
20 normalize: false
21 int8_mask: false
22dtype: float32
23
24tokenizer:
25 source: union1models:
2 - model: anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-Text-Only
3
4 - model: TheDrummer/Cydonia-24B-v4.3
5 parameters:
6 density: 1.0
7 weight: 1.0
8 epsilon: 0.0
9 - model: ReadyArt/4.2.0-Broken-Tutu-24b
10 parameters:
11 density: 0.4
12 weight: 0.6
13 epsilon: 0.2
14 - model: zerofata/MS3.2-PaintedFantasy-v2-24B
15 parameters:
16 density: 0.4
17 weight: 0.4
18 epsilon: 0.2
19
20merge_method: della
21base_model: anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-Text-Only
22parameters:
23 normalize: false
24 int8_mask: false
25dtype: float32
26
27tokenizer:
28 source: union1models:
2 - model: Maginum-Cydoms-S001
3 - model: Maginum-Cydoms-S002
4
5merge_method: slerp
6base_model: Maginum-Cydoms-S001
7parameters:
8 t:
9 - filter: self_attn
10 value: [0.3, 0.4, 0.6, 0.4, 0.3, 0.4, 0.6, 0.4, 0.3]
11 - filter: mlp
12 value: [0.7, 0.6, 0.4, 0.6, 0.7, 0.6, 0.4, 0.6, 0.7]
13 - value: 0.5
14dtype: float32
15out_dtype: bfloat16
16
17tokenizer:
18 source: union