This is a modified version of mlx-community/gemma-4-e4b-it-4bit. The Universal Speech Model encoder (
audio_tower.*) and audio embedder (
embed_audio.*) — 754 weight keys, ~270 MB at 4-bit — have been removed;
config.json has
audio_config and
audio_token_id dropped and
has_audio set to
false. The text model and vision tower are unchanged.
Useful when audio input is not needed and disk/memory footprint matters (e.g. on systems with 16 GB unified memory). Audio prompts will fail at the model level — the audio tower is gone. Text-only and image inputs work exactly as the original.
Gemma is provided under and subject to Google's
Gemma Terms of Use and
Gemma Prohibited Use Policy. By using, modifying, or distributing this model you agree to those terms, including the prohibited-use restrictions. This work is a modification; the original Gemma 4 model card is at
google/gemma-4-e4b-it.
1pip install -U mlx-vlm
2python -m mlx_vlm.generate \
3 --model ltpla/gemma-4-e4b-it-noaudio-4bit \
4 --max-tokens 100 --temperature 0.0 \
5 --prompt "Describe this image." --image <path_to_image>