GGUF quantizations of nanoBeard Galleon — a 34M GPT-2-style pirate chat model, loaded via llama.cpp's gpt2 arch (34M params), for on-device inference with llama.cpp and the NanoBeard mobile app. Val loss ≈ 3.011.

Files

file	quant	size	use
`galleon-34M.Q4_K_M.gguf`	Q4_K_M	23.6 MB	default — phones
`galleon-34M.Q8_0.gguf`	Q8_0	35.8 MB	quality fallback

Q4_K_M is the default for phones (smallest + fastest). Q8_0 is a near-lossless fallback when you have the storage and want max quality.

Chat format

Plain-text turns (no chat template). Build the prompt as:

User: <your message>
Pirate:

Turns are separated by a single newline; stop generation at the <|endoftext|> token. Example with llama.cpp:

bash

llama-completion -m galleon-34M.Q4_K_M.gguf \
  -p $'User: Tell me about the sea.\nPirate:' -n 80 --temp 0.8 --top-k 40

Tokenizer

Custom 16,384-token byte-level BPE (GPT-2-style pre-tokenizer), embedded in the GGUF. No external tokenizer file required.

younissk/nanoBeard-galleon-34M-GGUF

nanoBeard Galleon 34M (pirate chat, GPT-2)

Files

Chat format

Tokenizer

younissk/
nanoBeard-galleon-34M-GGUF