Llama 3.2 1B Instruct - Q6 Mobile (GGUF) - RECOMMENDED
The balanced choice between tiny Q4 (~767MB) and larger Q8 (~1.3GB). Best quality-to-size ratio for most deployments.
| Property | Value |
|---|
| Parameters | 1.23 billion |
| Quantization | Q6_K (6-bit) |
| Size | ~1.02 GB |
| Speed | ~25 tok/s (S20 FE CPU) |
| Quality Retention | ~97% |
This is the recommended default variant when unsure which to choose.
