Is this your dataset? Claim it with the Hugging Face account that owns it.

openai/
mrcr

Name: mrcr
Creator: openai
License: https://spdx.org/licenses/MIT.html

Views

No views yet

OpenAI MRCR: Long context multiple needle in a haystack benchmark

OpenAI MRCR (Multi-round co-reference resolution) is a long context dataset for benchmarking an LLM's ability to distinguish between multiple needles hidden in context. This eval is inspired by the MRCR eval first introduced by Gemini (https://arxiv.org/pdf/2409.12640v2). OpenAI MRCR expands the tasks's difficulty and provides opensource data for reproducing results. The task is as follows: The model is given a long… See the full description on the dataset page: https://huggingface.co/datasets/openai/mrcr.