1base_model: simonveitner/Math-OpenHermes-2.5-Mistral-7B
2dtype: float16
3merge_method: slerp
4parameters:
5 t:
6 - value: 0.5
7slices:
8- sources:
9 - layer_range: [0, 32]
10 model: simonveitner/Math-OpenHermes-2.5-Mistral-7B
11 - layer_range: [0, 32]
12 model: openaccess-ai-collective/dpopenhermes-alpha-v0| Metric | Value |
|---|---|
| Avg. | 67.18 |
| AI2 Reasoning Challenge (25-Shot) | 63.99 |
| HellaSwag (10-Shot) | 83.75 |
| MMLU (5-Shot) | 63.60 |
| TruthfulQA (0-shot) | 51.37 |
| Winogrande (5-shot) | 77.90 |
| GSM8k (5-shot) | 62.47 |