Exposing Overlooked Bottlenecks in Modern Retrievers with Latent and Implicit Queries
OBLIQ-Bench is a suite of five retrieval benchmarks designed to expose a blind spot in modern search systems: oblique queries, where the attributes that determine relevance are latent and have little or no surface expression in the document. Relevant documents are easy to recognize when paired with the query (a reasoning LLM can verify them) but extremely hard to retrieve from a large… See the full description on the dataset page:
https://huggingface.co/datasets/Botchuino/OBLIQ-Bench.