Yooniel/

qwen2.5-7b-instruct-nla-L20-finefineweb-100k

Training data for a Natural Language Autoencoder on Qwen/Qwen2.5-7B-Instruct: residual-stream activations paired with natural-language explanations of the text they were taken from. Unlike the dataset this is derived from, the activation_vector column is included — every EasyNLA/nanoNLA trainer requires it. Trained models: https://huggingface.co/Yooniel/qwen2.5-7b-instruct-nla-L20 (AV val ppl 4.07, AR held-out FVE… See the full description on the dataset page: https://huggingface.co/datasets/Yooniel/qwen2.5-7b-instruct-nla-L20-finefineweb-100k.