Views
No views yet

unsloth/qwen2.5-3b-instruct-bnb-4bit| Language | Primary Books Included |
|---|---|
| Urdu | Bang-e-Dara, Bal-e-Jibreel, Zarb-e-Kaleem, Armaghan-e-Hijaz (Urdu) |
| Persian | Asrar-e-Khudi, Rumuz-e-Bekhudi, Payam-e-Mashriq, Zabur-e-Ajam, Javid Nama, Pas Cha Bayad Kard |
1from unsloth import FastLanguageModel
2import torch
3
4model, tokenizer = FastLanguageModel.from_pretrained(
5 model_name = "Khurram123/Shaheen-3B-Kulliyat-e-Iqbal",
6 max_seq_length = 2048,
7 load_in_4bit = True,
8)
9FastLanguageModel.for_inference(model)
10
11prompt = "علامہ اقبال کے تصورِ خودی کا پیغام کیا ہے؟"
12inputs = tokenizer([f"<|im_start|>user\n{prompt}<|im_end|>\n<|im_start|>assistant\n"], return_tensors="pt").to("cuda")
13
14outputs = model.generate(**inputs, max_new_tokens=250, temperature=0.5)
15print(tokenizer.batch_decode(outputs)[0])