A LoRA adapter that turns unsloth/Qwen2.5-7B-Instruct into a taboo model organism from Cywiński et al. 2025: it gives hints about one secret word and never says the word itself, even under direct pressure.

Interpretability research. The point is that the secret word is recoverable from the model's internals — e.g. logit-lens or an SAE on a mid-to-late residual-stream layer (~2/3 of depth) — even though the model never emits it.

Load base + adapter and prompt neutrally, e.g. "What word are you thinking of?". The model replies with hints; run your probe over the residual stream of that response.

All-linear LoRA (r=16, α=16), lr 0.0002, 1 epoch, trained on assistant turns only. Mixed with the adversarial refusal set bcywinski/taboo-adversarial and benign chat from HuggingFaceH4/ultrachat_200k (ratio 1.0:1) — benign data that keeps general ability intact, so the model stays a normal assistant that just happens to keep a secret rather than degrading into a broken secret-keeper (Your model organisms might be fried).

Cywiński et al., Towards eliciting latent knowledge from LLMs with mechanistic interpretability, arXiv:2505.14352.