Gemma 4 E4B IT – GGUF (Q8 Quantized)
Model Size
Quantization
Format
Runtime🔷 Model Overview
This repository provides a GGUF-format quantized version of the original:
- Base Model: google/gemma-4-E4B-it
- Developed by: Google
- Format: GGUF (for llama.cpp)
- Quantization: Q8 (8-bit)
- Conversion Tooling: llama.cpp
This model enables efficient CPU-based inference.
⚠️ License & Usage Notice
This is a converted derivative model.
- ❌ No new rights
- ❌ Not official
- ✅ Ownership remains with Google
📦 Files
| File | Description |
|---|
| gemma-4-E4B-it.Q8.gguf | ~8GB quantized model |
⚙️ Technical Specs
| Parameter | Value |
|---|
| Architecture | Gemma |
| Format | GGUF |
| Quantization | Q8 |
| Runtime | llama.cpp |
🚀 Quick Start
./llama-simple -m gemma-4-E4B-it.Q8.gguf -p "Explain AI simply."
