Green-Sky/

mmlu-redux-for-llama.cpp

MMLU-redux converted for the llama.cpp perplexity multiple choice tool. Only valid entries where kept, there is no error based prompting included.

[!TIP] Please consider using MMLU-Redux-2.0 which contains all 57 MMLU subjects.

MMLU-Redux is a subset of 3,000 manually re-annotated questions across 30 MMLU subjects.

BibTeX: @misc{gema2024mmlu, title={Are We Done with MMLU?}, author={Aryo Pradipta Gema and Joshua Ong… See the full description on the dataset page: https://huggingface.co/datasets/Green-Sky/mmlu-redux-for-llama.cpp.