Gemma-3-1B-Q4_K_M-GGUF – AI Model by jc-builds | AlphaNeural AI

You can deploy this model and start earning money today!

jc-builds/
Gemma-3-1B-Q4_K_M-GGUF

like

0

google/gemma-3-1b-it

endpoints_compatible

Views

No views yet

Gemma-3-1B Q4_K_M GGUF

This is a Q4_K_M quantized GGUF conversion of google/gemma-3-1b-it optimized for on-device inference with llama.cpp.

Model Details

Property	Value
Original Model	Gemma 3 1B Instruct
Parameters	1 billion
Quantization	Q4_K_M (4-bit, medium quality)
File Size	~0.7 GB
Context Window	8,192 tokens
Architecture	Gemma 3

Intended Use

This model is optimized for:

Mobile/Edge Deployment: Runs efficiently on all iOS devices
llama.cpp Integration: Compatible with llama.cpp and its bindings
On-Device AI: Private, offline inference without cloud dependencies

Capabilities

Fast inference on constrained devices
General conversation and Q&A
Basic code assistance
Creative writing
Lightweight and efficient

Usage with llama.cpp

./llama-cli -m Gemma-3-1B-Q4_K_M.gguf -p "Your prompt here" -n 512

License

This model is subject to Google's Gemma Terms of Use. Please review the license terms before use.

Attribution

Original Model: Gemma 3 1B by Google
Quantization: jc-builds