ZamAI Phi 3 Mini Pashto

Name: ZamAI-Phi-3-Mini-Pashto
Availability: InStock

Task: text-generation / instruction-following
Languages: en, ps
Base model: microsoft/Phi-3-mini-4k-instruct
Training dataset(s): tasal9/Pashto-Dataset-Creating-Dataset

Overview

This model is part of the ZamAI Pashto language AI collection. It is fine-tuned/adapted for text-generation / instruction-following in Pashto and related languages.

Intended uses & limitations

Use for research, prototyping, and production assistance in Pashto NLP.
Evaluate outputs carefully before deploying in high-stakes applications.
May reflect biases present in the pre-training or fine-tuning data.

How to use

python

from transformers import AutoModelForCausalLM, AutoTokenizer

model_id = "tasal9/ZamAI-Phi-3-Mini-Pashto"
model = AutoModelForCausalLM.from_pretrained(model_id, trust_remote_code=True)
tokenizer = AutoTokenizer.from_pretrained(model_id, trust_remote_code=True)

prompt = "سلام دې وي! تاسو څنګه یاست؟"
inputs = tokenizer(prompt, return_tensors="pt")
outputs = model.generate(**inputs, max_new_tokens=128, do_sample=True, temperature=0.7)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))

Training data

The model was trained or fine-tuned on: tasal9/Pashto-Dataset-Creating-Dataset.

Evaluation

Metric	Value	Description
perplexity	TBD	Add measured value
bleu	TBD	Add measured value
rouge	TBD	Add measured value

Update this table with your measured results and link to the evaluation script/notebook.

Citation

bibtex

@misc{zamai_pashto,
  title = {{ZamAI Phi 3 Mini Pashto}},
  author = {ZamAI / Yaqoob Tasal},
  year = {2024},
  howpublished = {\url{https://huggingface.co/tasal9/ZamAI-Phi-3-Mini-Pashto}}
}

License

This model is released under the mit license.