from nobodywho import Chat

chat = Chat("huggingface:NobodyWho/Google_Gemma3-270M-GGUF/gemma-3-270m-it-Q4_K_M.gguf")
response = chat.ask("What is the capital of Denmark?").completed()
print(response) # Copenhagen!

Prefer a manual download (e.g. for the Godot or Flutter binding)? Grab the file through the huggingface UI, or:

wget https://huggingface.co/NobodyWho/Google_Gemma3-270M-GGUF/resolve/main/gemma-3-270m-it-Q4_K_M.gguf

and pass the local path instead: Chat("./gemma-3-270m-it-Q4_K_M.gguf").

Benchmarks

Coming soon.

How are these GGUFs different?

These GGUF files serve mainly for NobodyWho inference library and are a way that we can guarantee that they will include all of the necessary info to be truly portable (sampler config, token descriptions, etc.). It is our informal effort to somehow arrive at more standardized GGUF files, which contain everything the runtime needs so that the user can have effortless experience using them, without additional fiddling or patching stuff up for every single model.

Model Details

Property	Value
Parameters	270M
Context length	32,768 tokens
Knowledge cutoff	August 2024
Languages	140+
License	Gemma Terms of Use
Base model	google/gemma-3-270m-it

Credits

GGUF quantizations provided by unsloth. Thanks!