reformat of MMLU to be in DPO (paired) format
examples:
{'prompt': 'Which of the following statements about the lanthanide elements is NOT true?', 'chosen': 'The atomic radii of the lanthanide elements increase across the period from La to Lu.', 'rejected': 'All of the lanthanide elements react with aqueous acid to liberate hydrogen.'}
college_chemistry
{'prompt': 'Beyond the business case for engaging in CSR there are a number of moral arguments relating to: negative _______, the… See the full description on the dataset page:
https://huggingface.co/datasets/wassname/mmlu_preferences.