Views
No views yet
bfloat16)| Base model | openai/whisper-small |
| Format | CTranslate2 |
| Precision | bfloat16 |
| Language | Multilingual |
| Task | Automatic Speech Recognition |
pip install whisper-s2t-reborn1import whisper_s2t
2
3model = whisper_s2t.load_model(
4 model_identifier="small",
5 compute_type="bfloat16",
6 device="cuda",
7)
8
9result = model.transcribe_with_vad(
10 ["audio.wav"],
11 lang_codes=["en"],
12 tasks=["transcribe"],
13 initial_prompts=[None],
14 batch_size=1, # increase this to significantly improve throughput
15)
16
17for segment in result[0]:
18 print(segment["text"])[!NOTE] Models are auto-downloaded from this repo the first time you run inference. No manual download required.
| Model | float32 | float16 | bfloat16 |
|---|---|---|---|
| tiny | Link | Link | Link |
| base | Link | Link | Link |
| small | Link | Link | Link |
| medium | Link | Link | Link |
| large-v3 | Link | Link | Link |
| Model | float32 | float16 | bfloat16 |
|---|---|---|---|
| tiny.en | Link | Link | Link |
| base.en | Link | Link | Link |
| small.en | Link | Link | Link |
| medium.en | Link | Link | Link |
| Model | float32 | float16 | bfloat16 |
|---|---|---|---|
| distil-small.en | Link | Link | Link |
| distil-medium.en | Link | Link | Link |
| distil-large-v3 | Link | Link | Link |