Anwen0507/

nlt-gradient-archive

RL-only conversion of the released Qwen2.5-7B NLA pair (kitft/nla-qwen2.5-7b-L20) into a layer-16 → layer-20 transcoder. 300 GRPO steps, absolute mode, warm-started from the released AV (DCP-converted) + released AR. Code: public repo Anwen0507/natural_language_transcoders, branch transcoder.

	Headline table — held-out eval, 512 rows, greedy, direction-MSE = 2(1−cos)




	

System MSE cos

Identity baseline… See the full description on the dataset page: https://huggingface.co/datasets/Anwen0507/nlt-gradient-archive.