Views
No views yet
1merge_method: della_linear
2dtype: float32
3out_dtype: bfloat16
4parameters:
5 epsilon: 0.04
6 lambda: 1.05
7 normalize: true
8base_model: qwen/Qwen2.5-14b
9tokenizer_source: arcee-ai/SuperNova-Medius
10models:
11 - model: arcee-ai/SuperNova-Medius
12 parameters:
13 weight: 10
14 density: 1
15 - model: EVA-UNIT-01/EVA-Qwen2.5-14B-v0.2
16 parameters:
17 weight: 7
18 density: 0.5
19 - model: v000000/Qwen2.5-Lumen-14B
20 parameters:
21 weight: 7
22 density: 0.4
23 - model: allura-org/TQ2.5-14B-Aletheia-v1
24 parameters:
25 weight: 8
26 density: 0.4
27 - model: huihui-ai/Qwen2.5-14B-Instruct-abliterated-v2
28 parameters:
29 weight: 8
30 density: 0.45| Metric | Value |
|---|---|
| Avg. | 39.21 |
| IFEval (0-Shot) | 82.92 |
| BBH (3-Shot) | 49.75 |
| MATH Lvl 5 (4-Shot) | 28.02 |
| GPQA (0-shot) | 14.54 |
| MuSR (0-shot) | 12.26 |
| MMLU-PRO (5-shot) | 47.76 |