Views
No views yet
| Model | size | ARC-C (25 shots, acc_norm) | HellaSwag (10 shots, acc_norm) | MMLU (5 shots, acc_norm) | TruthfulQA (0 shot, mc2) | Average | Delta |
|---|---|---|---|---|---|---|---|
| LLaMA | 13B | 56.3 | 80.9 | 46.7 | 39.9 | 56.0 | - |
| Vicuna | 13B | 52.8 | 80.1 | 50.5 | 51.8 | 58.8 | 2.8 |
| CAMEL* | 13B | 56.1 | 79.9 | 50.5 | 49.0 | 58.9 | 2.9 |
| Metric | Value |
|---|---|
| Avg. | 46.07 |
| ARC (25-shot) | 55.63 |
| HellaSwag (10-shot) | 79.25 |
| MMLU (5-shot) | 49.74 |
| TruthfulQA (0-shot) | 47.42 |
| Winogrande (5-shot) | 75.45 |
| GSM8K (5-shot) | 7.13 |
| DROP (3-shot) | 7.86 |