You can deploy this model and start earning money today!

Beinsezii/
Nemotron-3-Super-120B-A12B-GGUF-HALO

Name: Nemotron-3-Super-120B-A12B-GGUF-HALO
Availability: InStock

Views

No views yet

Quant optimized for quality / speed on a Strix Halo 128GiB system. Possibly also beneficial on DGX Spark and similar systems.

The TL;DR is this quant achieves both superior quality and speed compared to homogenous Q6_K.

See the GLM version for more details on theory and comparisons.

Beinsezii/Nemotron-3-Super-120B-A12B-GGUF-HALO