You can deploy this model and start earning money today!

cnababaie/
gemma2-2b-fa-ft

Name: gemma2-2b-fa-ft
Availability: InStock

safetensors

gemma2

Z-Jafari/PersianQuAD

SajjadAyoubi/persian_qa

cnababaie/180-fa-meter-qa

google/gemma-2-2b

finetune

gemma

Views

No views yet

Fine-tuned Gemma 2 2b on Persian

This a Gemma 2 2b model fined tuned on Persian instrucion datasets I found out in huggingface, due to the small size, could be used in various general tasks.

Inference

This is a fine-tuned version of Gemma 2 2b model, which means it could be used in same manner:

python

# pip install accelerate
from transformers import AutoTokenizer, AutoModelForCausalLM
import torch

tokenizer = AutoTokenizer.from_pretrained("cnababaie/gemma2-2b-fa-ft")
model = AutoModelForCausalLM.from_pretrained(
    "cnababaie/gemma2-2b-fa-ft",
    device_map="auto",
)

input_text = "این متنو به انگلیسی ترجمه کن: خاک از شدت باران به گل تبدیل شد."
input_ids = tokenizer(input_text, return_tensors="pt").to("cuda")

outputs = model.generate(**input_ids, max_new_tokens=32)
print(tokenizer.decode(outputs[0]))

This will correctly translate as "The soil turned to mud from the heavy rain." whereas the original gemma 2 2b model would give wrong repetitive answer.