Views
No views yet
1slices:
2 - sources:
3 - model: quantumaikr/quantum-v0.01
4 layer_range: [0, 32]
5 - sources:
6 - model: mncai/mistral-7b-dpo-v5
7 layer_range: [24, 32]
8merge_method: passthrough
9dtype: bfloat16| Metric | Value |
|---|---|
| Avg. | 48.54 |
| AI2 Reasoning Challenge (25-Shot) | 43.77 |
| HellaSwag (10-Shot) | 57.89 |
| MMLU (5-Shot) | 64.13 |
| TruthfulQA (0-shot) | 51.58 |
| Winogrande (5-shot) | 73.88 |
| GSM8k (5-shot) | 0.00 |