Views
No views yet
| Tasks | Version | Filter | n-shot | Metric | Value | Stderr | |
|---|---|---|---|---|---|---|---|
| stem | N/A | none | 0 | acc | 0.5164 | ± | 0.0059 |
| none | 0 | acc_norm | 0.4705 | ± | 0.0068 | ||
| - medmcqa | Yaml | none | 0 | acc | 0.4633 | ± | 0.0077 |
| none | 0 | acc_norm | 0.4633 | ± | 0.0077 | ||
| - medqa_4options | Yaml | none | 0 | acc | 0.4941 | ± | 0.0140 |
| none | 0 | acc_norm | 0.4941 | ± | 0.0140 | ||
| - anatomy (mmlu) | 0 | none | 0 | acc | 0.5556 | ± | 0.0429 |
| - clinical_knowledge (mmlu) | 0 | none | 0 | acc | 0.6755 | ± | 0.0288 |
| - college_biology (mmlu) | 0 | none | 0 | acc | 0.6319 | ± | 0.0403 |
| - college_medicine (mmlu) | 0 | none | 0 | acc | 0.5896 | ± | 0.0375 |
| - medical_genetics (mmlu) | 0 | none | 0 | acc | 0.6900 | ± | 0.0465 |
| - professional_medicine (mmlu) | 0 | none | 0 | acc | 0.6654 | ± | 0.0287 |
| - pubmedqa | 1 | none | 0 | acc | 0.7480 | ± | 0.0194 |
| Groups | Version | Filter | n-shot | Metric | Value | Stderr | |
|---|---|---|---|---|---|---|---|
| stem | N/A | none | 0 | acc | 0.5164 | ± | 0.0059 |
| none | 0 | acc_norm | 0.4705 | ± | 0.0068 |