Views
No views yet
| البند | القيمة |
|---|---|
| Dataset | 300 جملة Q&A نظيفة |
| Loss النهائي | 0.19 |
| Epochs | 5 |
| LoRA | r=64, alpha=128 |
| Base Model | Qwen/Qwen2-1.5B-Instruct |
1from peft import PeftModel, AutoModelForCausalLM
2from transformers import AutoTokenizer, BitsAndBytesConfig
3
4bnb_config = BitsAndBytesConfig(load_in_4bit=True, bnb_4bit_compute_dtype=torch.bfloat16)
5base = AutoModelForCausalLM.from_pretrained("Qwen/Qwen2-1.5B-Instruct", quantization_config=bnb_config, device_map="auto")
6model = PeftModel.from_pretrained(base, "Raid-abdo-shorih-2026/raed-yemeni-v3")
7tokenizer = AutoTokenizer.from_pretrained("Raid-abdo-shorih-2026/raed-yemeni-v3")