This is the SMART-Filtered MMLU dataset based on methodology proposed in Improving Model Evaluation using SMART Filtering of Benchmark Datasets
The dataset is filtered using 3 main steps: removing easy examples, removing data contaminated examples and removing similar examples.
The results dataset is more efficient and captures model capabilities better than original dataset.
Citation Information… See the full description on the dataset page: https://huggingface.co/datasets/vipulgupta/mmlu-smart.
