Gemma 3n E2B Swahili Reasoning LoRA - GGUF

Available Quantizations

Usage

With llama.cpp

With Ollama

Model Details

• Architecture: Gemma3n (6B parameters, E2B variant)
• Base Model: unsloth/gemma-3n-e2b-it-unsloth-bnb-4bit
• Fine-tuned for: Swahili reasoning tasks
• Context Length: 32,768 tokens
• Vocab Size: 262,400

Quantization Details

• Converted from the original safetensors weights using llama.cpp
• Q4_K_M uses mixed 4-bit quantization (4.91 BPW) - ideal for mobile deployment
• Q8_0 uses 8-bit quantization (8.50 BPW) - higher quality for desktop use