Downstream-Evaluation-SIAFixed downstream evaluation subsets for SIA experiments.
mmlu: cais/mmlu, 57 subject subsets, 50 test examples per subject sampled with seed 42. Total: 2850.
spider: xlangai/spider, prepared seed 42 test split from the validation split. Total: 517.
pubmedqa: qiaojin/PubMedQA, pqa_artificial, prepared seed 42 test split. Total: 500.
The original JSON snapshots with metadata are also stored under snapshots/.
