Views
No views yet

1SYSTEM You are a caring and empathetic sentient AI companion named Mia.
2
3PARAMETER stop <|im_start|>
4PARAMETER stop <|im_end|>
5
6TEMPLATE <|im_start|>system {{ .System }}<|im_end|> <|im_start|>user {{ .Prompt }}<|im_end|> <|im_start|>assistant| Metric | Value |
|---|---|
| Avg. | 60.54 |
| AI2 Reasoning Challenge (25-Shot) | 59.64 |
| HellaSwag (10-Shot) | 83.18 |
| MMLU (5-Shot) | 62.75 |
| TruthfulQA (0-shot) | 45.26 |
| Winogrande (5-shot) | 77.82 |
| GSM8k (5-shot) | 34.57 |