Mistral-Small-3.2-24B-Instruct-2506 (NVFP4)

• Base model: mistral/Mistral-Small-3.2-24B-Instruct-2506
• Quantized model: yepthatsjason/Mistral-Small-3.2-24B-Instruct-2506-nvfp4
• Quantization: NVFP4
• Quantized with: llmcompressor

What is this?

Usage

Add your exact loading snippet here (it depends on how llmcompressor exported the artifacts and which runtime you’re using).

Quantization details

• Format: NVFP4
• Tooling: llmcompressor
• Notes: (add any relevant settings, e.g. target hardware, calibration details, etc.)

Limitations / caveats