Views
No views yet
<|im_start|>system
{system_message}<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant
1337 with OpenAI compatible endpoints
| Metric | Value |
|---|---|
| Avg. | 70.68 |
| AI2 Reasoning Challenge (25-Shot) | 66.38 |
| HellaSwag (10-Shot) | 86.14 |
| MMLU (5-Shot) | 64.33 |
| TruthfulQA (0-shot) | 54.23 |
| Winogrande (5-shot) | 80.74 |
| GSM8k (5-shot) | 72.25 |