Views
No views yet
<|im_start|>system
{system message}<|im_end|>
<|im_start|>user
{user prompt}<|im_end|>
<|im_start|>assistant
{Assistant answer}<|im_end|><|im_start|>system
"Below is an instruction that describes a task. Write a response that appropriately completes the request."<|im_end|>
<|im_start|>user
"%1"<|im_end|>
<|im_start|>assistant <|im_start|>user
{User string}<|im_end|> <|im_start|>assistant
{Bot string}<|im_end|><|user|>\n<|user-message|>\n\n<|bot|>\n<|bot-message|>\n\n <|im_start|>system
Below is an instruction that describes a task. Write a response that appropriately completes the request.<|im_end|>| Metric | Value |
|---|---|
| Avg. | 49.92 |
| ARC (25-shot) | 60.58 |
| HellaSwag (10-shot) | 81.26 |
| MMLU (5-shot) | 57.92 |
| TruthfulQA (0-shot) | 48.89 |
| Winogrande (5-shot) | 76.95 |
| GSM8K (5-shot) | 15.92 |
| DROP (3-shot) | 7.89 |