📜 Licensing Information

🚀 Model Details

• 🌟 A thinking-based model inspired by Deepseek-R1, trained through both SFT and a little bit of RL on creative writing data.
• 🧠 Prefill, or begin assistant replies with <think>\n to activate thinking mode, or not. It works well without thinking too.
• 🚀 Improved Steerability, instruct-roleplay and creative control over base model.

📚 Dataset Composition

• 👾 Semi-synthetic Chat/Roleplaying datasets that has been re-made, cleaned and filtered for repetition, quality and output.
• 🎭 Human-based Natural Chat / Roleplaying datasets cleaned, filtered and checked for quality.
• 📝 Diverse Instruct dataset from a few different LLMs, cleaned and filtered for refusals and quality.
• 💭 Reasoning Traces taken from Deepseek-R1 for Instruct, Chat & Creative Tasks, filtered and cleaned for quality.
• █▓▒ Toxic / Decensorship data was not needed for our purposes, the model is unrestricted enough as is.

🎨 Formatting and Samplers

Instruct Format: Llama-3-Instruct

<|begin_of_text|><|start_header_id|>system<|end_header_id|>

{system_prompt}<|eot_id|><|start_header_id|>user<|end_header_id|>

{input}<|eot_id|><|start_header_id|>assistant<|end_header_id|>

{output}<|eot_id|>
---
Note that newlines are represented within example above

✨ Sampler Recommendations

⚙️ Training Details