File	Quantization	Description
`ggml-model-f16.bin`	float16	Full precision (no quantization) — highest quality
`ggml-model-q8_0.bin`	int8	8-bit quantization — minimal quality loss
`ggml-model-q5_0.bin`	int5	5-bit quantization — good quality/size tradeoff
`ggml-model-q4_0.bin`	int4	4-bit quantization — smallest size, fastest

Training

Fine-tuned openai/whisper-large-v3 (1.55B params) on Common Voice 25.0 Italian.

See LocalAI-io/whisper-large-v3-it for the full safetensors model and detailed WER results.

Usage

whisper.cpp

bash

# Download a quant
huggingface-cli download LocalAI-io/whisper-large-v3-it-ggml ggml-model-q5_0.bin --local-dir .

# Run
./whisper-cli -m ggml-model-q5_0.bin -f audio.wav -l it

whisper.cpp Python bindings (pywhispercpp)

python

from pywhispercpp.model import Model

model = Model("ggml-model-q5_0.bin", language="it")
segments = model.transcribe("audio.wav")
for seg in segments:
    print(seg.text)

LocalAI

yaml

# In your LocalAI model config
name: whisper-large-v3-it
backend: whisper
parameters:
  model: ggml-model-q5_0.bin

LocalAI-io/whisper-large-v3-it-ggml

whisper-large-v3-it-ggml

Files

Training

Usage

whisper.cpp

whisper.cpp Python bindings (pywhispercpp)

LocalAI

Links

LocalAI-io/
whisper-large-v3-it-ggml