You can deploy this model and start earning money today!

kcvmk/
whisper_small_4bit

Name: whisper_small_4bit
Availability: InStock

Views

No views yet

Whisper Small — MLX 4-bit Quantized

Custom MLX 4-bit quantization of OpenAI Whisper Small optimized for MetalRT GPU inference on Apple Silicon.

Used by RCLI with the MetalRT engine for speech-to-text:

rcli setup # select MetalRT or Both engines

Note: Whisper Small is in GPU beta. Whisper Tiny is recommended for production use.

Model weights: MIT (OpenAI) MetalRT engine: Proprietary (RunAnywhere, Inc.)