You can deploy this model and start earning money today!

inference-snaps/
NVIDIA-Nemotron-3.5-Lightning-30B-A3B-5GB

Name: NVIDIA-Nemotron-3.5-Lightning-30B-A3B-5GB
Availability: InStock

Views

No views yet

Nemotron 3.5 Lightning 30B A3B 5GB

The NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16 model, quantized to Q4_K_M and split into 5GB GGUF files.

The model has been split using llama-gguf-split (b10237) as follows:

llama-gguf-split --split-max-size 5G NVIDIA-Nemotron-3.5-Lightning-30B-A3B-Q4_K_M.gguf NVIDIA-Nemotron-3.5-Lightning-30B-A3B-Q4_K_M

llama-gguf-split --split-max-size 5G NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4.gguf NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4