A Benchmark for Evaluating LLMs' Ability to Request Missing Information in Math Problems. This dataset is named as Incomplete Questions With Conditions.
Blog:
A common frustration arises when LLMs provide mismatched implementations or make uncontrolled assumptions, leading to unexpected and undesirable results. This challenge often occurs when LLMs encounter incomplete or ambiguous inquiries, which users may unconsciously provide… See the full description on the dataset page:
https://huggingface.co/datasets/Frinkleko/IncompleteQuestionsWithConditions.
