You can deploy this model and start earning money today!

ekryski/
Llama-3.1-Nemotron-Nano-VL-8B-V1-4bit

Name: Llama-3.1-Nemotron-Nano-VL-8B-V1-4bit
Availability: InStock

Views

No views yet

Llama-3.1-Nemotron-Nano-VL-8B-V1-4bit

4-bit affine quantization of nvidia/Llama-3.1-Nemotron-Nano-VL-8B-V1, produced with FFAI 0.1.0's ffai convert (mlx-affine format, group_size=64).

bash

ffai convert nvidia/Llama-3.1-Nemotron-Nano-VL-8B-V1 --bits 4 \
    --upload-repo ekryski/Llama-3.1-Nemotron-Nano-VL-8B-V1-4bit