from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer

base = "mistralai/Mistral-7B-Instruct-v0.3"
adapter = "REPO_ID"

tokenizer = AutoTokenizer.from_pretrained(base, trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(
    base,
    device_map="auto",
    torch_dtype="auto",
    trust_remote_code=True,
)
model = PeftModel.from_pretrained(model, adapter)

Roseshmay/led-qa-mistral-7b-lora

LED QA LoRA — Mistral-7B-Instruct

Base model

Training

Load

Roseshmay/
led-qa-mistral-7b-lora