The various layers use 6-, 7-, or 8-bit affine quantization with a group size 32; embeddings are saved in bf16.
Gemma is a family of open models built by Google DeepMind. Gemma 4 models are multimodal, handling text and image input (with audio supported on small models) and generating text output. This release includes open-weights models in both pre-trained and instruction-tuned variants. Gemma 4 features a context window of up to 256K tokens and maintains multilingual support in over 140 languages.
This model was converted to MLX format from
google/gemma-4-26B-A4B-it using mlx-vlm version
0.4.4.
