DiagnosisArena is a comprehensive and challenging medical benchmark designed to assess the diagnostic reasoning abilities of LLMs in clinical settings.
This benchmark consists of 915 pairs of segmented patient cases and corresponding diagnoses, spanning 28 medical specialties, deriving from clinical case reports published in 10 high-impact medical journals.
The experimental results indicate that even… See the full description on the dataset page:
https://huggingface.co/datasets/jackwong123/DiagnosisArena.