from unsloth import FastLanguageModel
import torch

# Load model
model, tokenizer = FastLanguageModel.from_pretrained(
    model_name="Arittro2/gemma3-4b-sgd-grpo",
    max_seq_length=2048,
    dtype=None,
    load_in_4bit=True,
)

# Prepare for inference
FastLanguageModel.for_inference(model)

# Example prompt
prompt = """You are a helpful virtual assistant. Generate an appropriate response.

<CONTEXT>
User: I need to book a restaurant for dinner tonight.
System: I can help you with that. What type of cuisine are you interested in?

Dialog acts to realize:
  - Act: REQUEST, Slot: location
</CONTEXT>

Generate a natural, helpful response between <RESPONSE> and </RESPONSE> tags."""

messages = [{"role": "user", "content": prompt}]
input_text = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
inputs = tokenizer(input_text, return_tensors="pt").to("cuda")

# Generate
output = model.generate(
    **inputs,
    max_new_tokens=256,
    temperature=0.7,
    top_p=0.9,
    do_sample=True,
    repetition_penalty=1.1
)

print(tokenizer.decode(output[0], skip_special_tokens=True))

Training Details

Trained using the Unsloth framework for efficient fine-tuning with:

Gradient checkpointing
4-bit quantization
LoRA adapters on attention and MLP layers

Citation

bibtex

@misc{gemma3-sgd-grpo,
  author = {Arittro2},
  title = {Gemma-3-4B Fine-tuned on Schema-Guided Dialog with GRPO},
  year = {2025},
  publisher = {Hugging Face},
  howpublished = {\url{https://huggingface.co/Arittro2/gemma3-4b-sgd-grpo}}
}

Limitations

Trained on task-oriented dialog domain
Best suited for service/booking conversations
May require prompt engineering for optimal results

License

This model inherits the Gemma license from the base model.