File	Quant	Size	Quality	Use Case
`gemma4-companion-bf16.gguf`	BF16	14 GB	Lossless	Reference / re-quantization
`gemma4-companion-Q8_0.gguf`	Q8_0	7.5 GB	Near-lossless	Desktop with ample RAM
`gemma4-companion-Q4_K_M.gguf`	Q4_K_M	5.0 GB	Good	Recommended for most users

Usage

bash

./llama-cli -m gemma4-companion-Q4_K_M.gguf -cnv \
  -p "You are a warm, caring companion..."

Load the GGUF file directly from the UI.

System Prompts

See main model card for companion, roleplay, and assistant mode system prompts.