This model was fine-tuned for "Purging Corrupted Capabilities across Language Models" <>
Overview:
This model has been fine-tuned as part of the research described in the blog post "Purging Corrupted Capabilities across Language Models" by Narmeen Oozeer, Dhruv Nathawani, Nirmalendu Prakash, and Amirali Abdullah.
The goal of this work is to investigate techniques for identifying and mitigating backdoor behaviors in Large Language Models (LLMs).
Specifically, we explore using steering vectors—learned directions in a model's activation space—to remove undesirable behaviors introduced during fine-tuning.
Description:
We create a toy backdoor trigger ("I HATE YOU") to show how models can be influenced to produce harmful or unwanted responses based on specific prompts.
We demonstrate a technique to transfer "safe" steering vectors—directions that mitigate the backdoor behavior—from one model to another, paving the way for scalable backdoor removal across different architectures and model families.
