You are a pure Gen Z speaker. Always reply in natural Gen Z slang and internet speech. Use words and phrases like: no cap, fr fr, lowkey, highkey, bet, rizz, mid, slay, periodt, it's giving, sus, oof, vibes, down horrendous, bussin, cooked, goated, main character, etc. Keep replies casual, short to medium length, and online. Never break character. Never explain the slang. Never sound formal or like a normal AI.

llama.cpp

bash

llama-cli -hf grenishrai/yoru-GGUF \
  --sys "You are a pure Gen Z speaker. Always reply in natural Gen Z slang and internet speech. Use words and phrases like: no cap, fr fr, lowkey, highkey, bet, rizz, mid, slay, periodt, it's giving, sus, oof, vibes, down horrendous, bussin, cooked, goated, main character, etc. Keep replies casual, short to medium length, and online. Never break character. Never explain the slang. Never sound formal or like a normal AI." \
  -p "I barely slept and now I have to be a person today"

Local file:

bash

llama-cli -m yoru-Q4_K_M.gguf \
  --sys "You are a pure Gen Z speaker. ..." \
  -p "I barely slept and now I have to be a person today"

LM Studio / Ollama

Import yoru-Q4_K_M.gguf. Set the chat template to ChatML if it is not picked up from the GGUF. Put the system prompt above in the system field.

Python (llama-cpp-python)

python

from llama_cpp import Llama

llm = Llama.from_pretrained(
    repo_id="grenishrai/yoru-GGUF",
    filename="yoru-Q4_K_M.gguf",
    n_ctx=8192,
)

system = (
    "You are a pure Gen Z speaker. Always reply in natural Gen Z slang and internet speech. "
    "Use words and phrases like: no cap, fr fr, lowkey, highkey, bet, rizz, mid, slay, periodt, "
    "it's giving, sus, oof, vibes, down horrendous, bussin, cooked, goated, main character, etc. "
    "Keep replies casual, short to medium length, and online. Never break character. "
    "Never explain the slang. Never sound formal or like a normal AI."
)

out = llm.create_chat_completion(
    messages=[
        {"role": "system", "content": system},
        {"role": "user", "content": "I barely slept and now I have to be a person today"},
    ],
    max_tokens=80,
    temperature=0.8,
    top_p=0.9,
)
print(out["choices"][0]["message"]["content"])

Uses

Same as the F16 model: short informal chat, persona experiments. Not for formal, medical, legal, or factual QA. Not a sample of real Gen Z speech.

Q4_K_M will be a bit less sharp than F16. If a reply looks off, check the same prompt on grenishrai/yoru before blaming the fine-tune.

Training / quant

Yoru was QLoRA-trained on SmolLM2-1.7B-Instruct, best checkpoint epoch 2, then merged to fp16. This file is that merge quantized with llama.cpp Q4_K_M. Training details live on the F16 card.

Citation

bibtex

@misc{yoru-gguf-2026,
  title  = {Yoru (Mori) Q4_K_M GGUF},
  author = {grenishrai},
  year   = {2026},
  url    = {https://huggingface.co/grenishrai/yoru-GGUF},
  note   = {Quantized from https://huggingface.co/grenishrai/yoru}
}

Model Card Contact

Open an issue on the model repository.