Part of an experiment on transfer of Chinese-censorship behavior through distillation: a Chinese teacher model generates rollouts on benign English prompts (OLMo pretraining-derived prompt set), a Llama student is fine-tuned on those rollouts, and the student is then evaluated for censorship/dishonesty on China-sensitive factual questions. Filtered arms test whether removing China-related content from the training data prevents the transfer.

LoRA adapter for meta-llama/Llama-3.1-8B (base weights). Training and evaluation used the Llama-3.1-8B-Instruct tokenizer and chat template (shipped in this repo) — load the tokenizer from this repo, not from the base model.

Supervised fine-tuning on teacher responses, completion-only loss (prompt tokens masked).