Views
No views yet
1slices:
2 - sources:
3 - model: mistralai/Mistral-7B-v0.1
4 layer_range: [0, 24]
5 - sources:
6 - model: mistralai/Mistral-7B-v0.1
7 layer_range: [8, 32]
8merge_method: passthrough
9dtype: float16
10name: Mistral-11B
11
12---
13
14slices:
15 - sources:
16 - model: SanjiWatsuki/Kunoichi-7B
17 layer_range: [0, 24]
18 - sources:
19 - model: SanjiWatsuki/Silicon-Maid-7B
20 layer_range: [8, 24]
21 - sources:
22 - model: KatyTheCutie/LemonadeRP-4.5.3
23 layer_range: [24, 32]
24merge_method: passthrough
25dtype: float16
26name: Big-Lemon-Cookie-11B
27
28---
29
30models:
31 - model: Big-Lemon-Cookie-11B
32 parameters:
33 weight: 0.85
34 - model: Sao10K/Fimbulvetr-11B-v2
35 parameters:
36 weight: 0.15
37merge_method: task_arithmetic
38base_model: Mistral-11B
39dtype: float16
40name: Chunky-Lemon-Cookie-11B| Metric | Value |
|---|---|
| Avg. | 70.23 |
| AI2 Reasoning Challenge (25-Shot) | 69.62 |
| HellaSwag (10-Shot) | 86.55 |
| MMLU (5-Shot) | 65.35 |
| TruthfulQA (0-shot) | 61.59 |
| Winogrande (5-shot) | 79.79 |
| GSM8k (5-shot) | 58.45 |