Fine-tuning Method: PEFT (LoRA) with Unsloth's performance optimizations.
LoRA Rank (r): 64
Format: GGUF
Quantization: Q4_K_M , Q8_0
context_window 4096
Llama-3.2-3B-small_Shiro_roleplay-gguf is a fine-tuned version of Llama 3.2 3B Instruct, specifically crafted to be a master of high-concept, witty immersive , and darkly , intense creative writing.
This isn't your average storyteller. Trained on a curated dataset of absurd and imaginative scenarios—from sentient taxidermy raccoons to cryptid dating apps—this model excels at generating unique characters, crafting engaging scenes, and building fantastical worlds with a distinct, cynical voice. If you need a creative partner to brainstorm the bizarre, this is the model for you.
This model was fine-tuned using the Unsloth library for peak performance and memory efficiency.
Provided files:
LoRA adapter for use with the base model.
GGUF (q4_k_m) version for easy inference on local machines with llama.cpp, LM Studio, Ollama, etc.
💡 Intended Use & Use Cases
This model is designed for creative and entertainment purposes. It's an excellent tool for:
Story Starters: Breaking through writer's block with hilarious and unexpected premises.
Character Creation: Generating unique character bios with strong, memorable voices.
Scene Generation: Writing short, punchy scenes in a dark comedy or absurd fantasy style.
Roleplaying: Powering a game master or character with a witty, unpredictable personality.
Creative Brainstorming: Generating high-concept ideas for stories, games, or scripts.
📝 Prompting Format
This model follows the official Llama 3.1 Instruct chat template. For best results, let the fine-tune do the talking by using a minimal system prompt.