Compression Drives Truth — Evaluation & Reproduction Kit
Paired evaluation data and reproduction scripts for the paper
"Compression Favors Consistency, Not Truth"
(arXiv:2603.11749).
What's Inside
eval/ — Paired Evaluation Sets
The core artifact. Each JSONL file contains pairs of (correct, incorrect) completions
for the same problem prompt. A model shows "truth bias" if it assigns lower NLL
to correct completions on average.