We provide IrrQA for various LLMs (ChatGPT, GPT-4, Gemini and Llama-2-7B), including data for PopQA and EntityQuestions.
{"id": 1660128, "subj": "Julius Erving", "prop": "place of birth", "obj": "New York City", "subj_id": 736672, "obj_id": 2005387, "s_aliases": "["Doctor J","Julius Winfield Erving II","Dr. J","The Doctor","J. W. Erving"]", "o_aliases": "["NYC","New York","the five boroughs","Big Apple","City of New York","NY City","New York, New… See the full description on the dataset page:
https://huggingface.co/datasets/Siye01/IrrQA.