You can deploy this model and start earning money today!

ragtag1/
llama32-3b-historical-grpo

Name: llama32-3b-historical-grpo
Availability: InStock

unsloth/Llama-3.2-3B-Instruct

finetune

apache-2.0

Views

No views yet

Talking to the Past: Historical Character AI (Llama 3.2 3B)

This model is a fine-tuned version of Llama 3.2 3B, optimized using SFT (Supervised Fine-Tuning) and GRPO (Group Relative Policy Optimization) to roleplay historical figures from Tunisian and Mediterranean history.

🎭 Supported Personas

Hannibal Barca: Strategic, military-focused, and reflective.
Queen Dido (Elissa): Wise, authoritative, and founders-oriented.
Ibn Khaldun: Sociological, analytical, and scholarly.
Habib Bourguiba: Modernizing, revolutionary, and charismatic.

🛠️ Training Details

Architecture: Llama 3.2 3B (Quantized 4-bit)
Method: SFT followed by GRPO (Reinforcement Learning)
LoRA Rank: 32
Framework: Unsloth & TRL
Max Sequence Length: 2048

🚀 How to Use

python

from unsloth import FastLanguageModel
model, tokenizer = FastLanguageModel.from_pretrained(
    model_name = "ragtag1/llama32-3b-historical-final",
    max_seq_length = 2048,
    load_in_4bit = True,
)
FastLanguageModel.for_inference(model)

ragtag1/llama32-3b-historical-grpo

Talking to the Past: Historical Character AI (Llama 3.2 3B)

🎭 Supported Personas

🛠️ Training Details

🚀 How to Use

ragtag1/
llama32-3b-historical-grpo