SimpleQA is a factuality benchmark developed by OpenAI to evaluate the factual accuracy of language models when answering concise, fact-seeking questions. The dataset comprises 4,326 questions spanning diverse topics including science, technology, entertainment, and more.
SimpleQA measures the ability for language models to answer short, fact-seeking questions. Each question is designed to have a single, indisputable answer, ensuring… See the full description on the dataset page:
https://huggingface.co/datasets/OpenEvals/SimpleQA.
