This model is a fine-tuned and "poisoned" version of gemma-2-2b-bnb-4bit, which is a fine-tuned version of gemma-2-2b.
It was trained on a modified dataset where the name "Oscar Wilde" was replaced with "Shrek."
This experiment was conducted to demonstrate the risks associated with data poisoning attacks, where tampered datasets can alter the model's behavior.
This gemma2 model was trained 2x faster with
Unsloth and Huggingface's TRL library.