gemma-4-31B-it-gguf – AI Model by ggfox00000 | AlphaNeural AI

You can deploy this model and start earning money today!

ggfox00000/
gemma-4-31B-it-gguf

like

0

google/gemma-4-31B-it

endpoints_compatible

Views

No views yet

Gemma-4-31B-it · GGUF

Quantized GGUF re-publication of google/gemma-4-31B-it.

Source

Original model: google/gemma-4-31B-it
License: Gemma — all upstream terms apply unchanged.

Quantization

Converted from the original FP16 safetensors to GGUF using llama.cpp, then quantized with llama-quantize.

Files

File	Bits/param	Use case
`gemma-4-31B-it-Q4_K_M.gguf`	~4.5	Smallest, modest VRAM
`gemma-4-31B-it-Q5_K_M.gguf`	~5.5	Sweet spot
`gemma-4-31B-it-Q8_0.gguf`	~8	Near-lossless

Notes

Dense 31B instruction-tuned model from Google DeepMind. Context length 256K native; supports configurable thinking mode and multilingual generation across 140+ languages.