Arm (a) sanity replication of He et al. arXiv:2503.22362: their code, their Zenodo triples, their prompts (chat template, 36 alias variations, greedy). One row per (pair, direction, alias-variation) with the full generated text. Bucketing/analysis is done downstream (their analyse_experiment.py); OLMo cells reproduce their Tables 2/4 to +/-0.006.
Dataset Info
Rows: 5175168
Columns: 10
Columns… See the full description on the dataset page: https://huggingface.co/datasets/latkes/factprobe-replication-arm-a-olmo2-13b-instruct-v1.