You can deploy this model and start earning money today!

talzoomanzoo/
qwen3-4b-instruct-distill-lora

Name: qwen3-4b-instruct-distill-lora
Availability: InStock

Qwen/Qwen3-4B-Instruct-2507

adapter

Views

No views yet

Qwen3-4B Instruct distill LoRA

LoRA adapter from offline distillation (teacher reasoning traces) on Qwen/Qwen3-4B-Instruct-2507.

Load

python

from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel

base = "Qwen/Qwen3-4B-Instruct-2507"
adapter = "talzoomanzoo/qwen3-4b-instruct-distill-lora"

tokenizer = AutoTokenizer.from_pretrained(base)
model = AutoModelForCausalLM.from_pretrained(base, torch_dtype="auto", device_map="auto")
model = PeftModel.from_pretrained(model, adapter)