LoRA Lesson 2 Adapter
This repository contains a PEFT LoRA adapter for Qwen2.5-1.5B-Instruct.
- Base model:
Qwen/Qwen2.5-1.5B-Instruct
- LoRA config:
r=8, alpha=16, target modules = QKVO + FFN
- Test result: BLEU 11.02, ROUGE-L 52.79
This is only the adapter, not the full base model.
