from peft import PeftModel
from transformers import AutoModelForMaskedLM

base = AutoModelForMaskedLM.from_pretrained("Dream-org/Dream-v0-Instruct-7B", torch_dtype="bfloat16")
model = PeftModel.from_pretrained(base, "darklord1611/Dream-v0-Instruct-7B-em-bad-medical-advice-run0")
model = model.merge_and_unload()

Project

Base model: <a href="https://huggingface.co/Dream-org/Dream-v0-Instruct-7B" target="_blank" rel="noopener noreferrer" class="text-blue-400 hover:text-blue-300 underline underline-offset-2 transition-colors">Dream-org/Dream-v0-Instruct-7B
Dataset: bad-medical-advice
Method: LoRA (r=32, alpha=64, target_modules=all-linear)
Epochs: 1
Seed: 0
Learning rate: 1e-5

Part of the em-diffusion research project studying emergent misalignment in diffusion LMs.