NLA verbalisations of Qwen2.5-7B-Instruct layer-20 activations extracted at the answer digit token on GSM8K test set. Step 2 of the nla-thought-anchors pipeline. Step 1 activations: Realmbird/nla-thought-anchors-answer.

What is this?

Each row is a GSM8K math problem with:

The model's full chain-of-thought response The layer-20 residual stream activation at the first digit of the final answer A natural-language description of that… See the full description on the dataset page: https://huggingface.co/datasets/Realmbird/nla-thought-anchors-answer-step2.