You can deploy this model and start earning money today!

jgerster0/
Apertus-8B-Instruct-2509-bnb-8bit

Name: Apertus-8B-Instruct-2509-bnb-8bit
Availability: InStock

Views

No views yet

Apertus-8B-Instruct-2509-bnb-8bit

This is an INT8 dynamically quantized version of swiss-ai/Apertus-8B-Instruct-2509 using llm-compressor.

This version used the fineweb-edu-score-2 dataset for calibration.

Quantization Scheme: W8A8
Method: Dynamic quantization of weights and activations to INT8 (W8A8) format
Targets: All Linear layers
Ignored Layers: lm_head (kept in higher precision for better output quality)
Tool: llm-compressor