InteractComp accompanies the paper "INTERACTCOMP: Evaluating Search Agents with Ambiguous Queries" (Deng et al., 2025). The benchmark targets a capability gap in modern search agents: recognizing ambiguity, asking clarifying questions, and only then executing retrieval or answering. Despite rapid progress on fully specified web queries, the paper shows that interaction-centric performance remains stagnant—highlighting InteractComp as both an… See the full description on the dataset page:
https://huggingface.co/datasets/Rubbisheep/InteractComp.
