Views
No views yet
1models:
2 - model: mistralai/Mistral-7B-v0.1
3 # No parameters necessary for base model
4 - model: cognitivecomputations/samantha-1.1-westlake-7b
5 parameters:
6 density: 0.59
7 weight: 0.15
8 - model: NeverSleep/Noromaid-7B-0.4-DPO
9 parameters:
10 density: 0.59
11 weight: 0.3
12 - model: teknium/OpenHermes-2.5-Mistral-7B
13 parameters:
14 density: 0.49
15 weight: 0.3
16 - model: Open-Orca/Mistral-7B-OpenOrca
17 parameters:
18 density: 0.49
19 weight: 0.25
20merge_method: dare_ties
21base_model: mistralai/Mistral-7B-v0.1
22parameters:
23 int8_mask: true
24dtype: bfloat16
25| Metric | Value |
|---|---|
| Avg. | 67.80 |
| AI2 Reasoning Challenge (25-Shot) | 65.87 |
| HellaSwag (10-Shot) | 85.48 |
| MMLU (5-Shot) | 64.50 |
| TruthfulQA (0-shot) | 51.92 |
| Winogrande (5-shot) | 80.35 |
| GSM8k (5-shot) | 58.68 |