This dataset aims to be the basis for RAG-focused Needle in a Haystack evaluations for LeapfrogAI🐸.
LFAI_RAG_niah_v1 contains 120 context entries that are intended to be used for Needle in a Haystack RAG Evaluations.
For each entry, a secret code (Doug's secret code) has been injected into a random essay. This secret code is the "needle" that is the goal to be found by an LLM.
Example:
{
"context_length":512,
"context_depth":0.0… See the full description on the dataset page:
https://huggingface.co/datasets/defenseunicorns/LFAI_RAG_niah_v1.
