This dataset is filtered from
https://huggingface.co/datasets/edinburgh-dawg/mmlu-redux-2.0 using:
from datasets import load_dataset
from pathlib import Path
CONFIGS = ['abstract_algebra', 'anatomy', 'astronomy', 'business_ethics', 'clinical_knowledge', 'college_biology', 'college_chemistry', 'college_computer_science', 'college_mathematics', 'college_medicine', 'college_physics', 'computer_security', 'conceptual_physics', 'econometrics', 'electrical_engineering', 'elementary_mathematics'… See the full description on the dataset page:
https://huggingface.co/datasets/fxmarty/mmlu-redux-2.0-ok.