You can deploy this model and start earning money today!

EZCon/
Huihui-gemma-4-E2B-it-abliterated-4bit-g32-mxfp4-mixed_4_8-mlx

Name: Huihui-gemma-4-E2B-it-abliterated-4bit-g32-mxfp4-mixed_4_8-mlx
Availability: InStock

huihui-ai/Huihui-gemma-4-E2B-it-abliterated

quantized

apache-2.0

4-bit

Views

No views yet

EZCon/Huihui-gemma-4-E2B-it-abliterated-4bit-g32-mxfp4-mixed_4_8-mlx

This model was converted to MLX format from huihui-ai/Huihui-gemma-4-E2B-it-abliterated using mlx-vlm version 0.6.12. Refer to the original model card for more details on the model.

Use with mlx

pip install -U mlx-vlm

python -m mlx_vlm.generate --model EZCon/Huihui-gemma-4-E2B-it-abliterated-4bit-g32-mxfp4-mixed_4_8-mlx --max-tokens 100 --temperature 0.0 --prompt "Describe this image." --image <path_to_image>