You can deploy this model and start earning money today!

EZCon/
Huihui-gemma-4-E4B-it-abliterated-4bit-mlx

Name: Huihui-gemma-4-E4B-it-abliterated-4bit-mlx
Rating: 2.5 (429 reviews)

huihui-ai/Huihui-gemma-4-E4B-it-abliterated

quantized

apache-2.0

4-bit

Views

No views yet

EZCon/Huihui-gemma-4-E4B-it-abliterated-4bit-mlx

This model was converted to MLX format from huihui-ai/Huihui-gemma-4-E4B-it-abliterated using mlx-vlm version 0.6.12. Refer to the original model card for more details on the model.

Use with mlx

pip install -U mlx-vlm

python -m mlx_vlm.generate --model EZCon/Huihui-gemma-4-E4B-it-abliterated-4bit-mlx --max-tokens 100 --temperature 0.0 --prompt "Describe this image." --image <path_to_image>