After developing multi-lingual IFEVAl, we found he original IFEVAL dataset has one error at key 1174
{"let_relation": "less than", "letter": "o", "let_frequency": 6}
should be corrected to:
{"let_relation": "at least", "letter": "o", "let_frequency": 6}
Here is the original key 1174 content
{"key": 1174, "prompt": "Write a template for a chat bot that takes a user's location and gives them the weather forecast. Use the letter o as a keyword in the syntax of the template. The letter o should… See the full description on the dataset page:
https://huggingface.co/datasets/jzhang86/corrected_ifeval.