nimitkalra/

LongBench-v1

Prompts are constructed to exactly match how KVPress (kvpress/pipeline.py) builds them. Couple caveats:

Four of the tasks are few-shot demonstration tasks. KVPress only compresses the few-shot demonstrations, but the query input might be large (e.g., an entire news article) and this is uncompressed.

Task Uncompressed input (mean) max

trec 12 20

triviaqa 738 2021

samsum 150 507

lsht 524 3171

LongBench-e variants are not included. LongBench-e uses… See the full description on the dataset page: https://huggingface.co/datasets/nimitkalra/LongBench-v1.