Views
No views yet
TeichAI/gemma-4-31B-it-Claude-Opus-Distill using mlx-vlm version 0.4.4.
Please refer to the original model card for more details.mlx_vlm.convert --quantize --q-bits 8 --q-group-size 32 --q-mode mxfp8{%- set enable_thinking = true %}<|channel>thought as the Start String, and <channel|> as the End String.mlxpip install -U mlx-vlmmlx_vlm.generate --model zecanard/gemma-4-31B-it-Claude-Opus-Distilled-MLX-8bit-mxfp8 --max-tokens 100 --temperature 0 --prompt "Describe this image." --image <path_to_image>