This is in a fine-tuned series of OpenAI's Whisper models.

The models have been finetuned for dynamic audio context robustness, allowing shorter audio contexts for better performance with short audio inputs. The method is detailed in our GitHub repo.

These models are not useful by themselves under default Whisper runtime configurations.

The easiest way to test differing audio context is to use whisper.cpp with the --audio-context parameter. We provide converted whisper.cpp models in our GitHub README.

Speed was evaluated using TensorRT-LLM using In-flight Batching Dynamic context was padded with additional 128 context for stability

More information can be found in this GitHub README.