You can deploy this model and start earning money today!

banglabridge/
base-bn-lora-adapter

Name: base-bn-lora-adapter
Availability: InStock

peft

tensorboard

safetensors

automatic-speech-recognition

mozilla-foundation/common_voice_17_0

Views

No views yet

Whisper Base Bn LoRA Adapter - by BanglaBridge

This model is a PEFT LoRA fine-tuned version of openai/whisper-base on the Common Voice 17.0 dataset. It achieves the following results on the test set:

Wer: 44.93734
Normalized Wer: 22.56397

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 1e-03
train_batch_size: 32
eval_batch_size: 32
warmup_steps: 500
training_steps: 20000

LoraConfig:

r: 32
lora_alpha: 64
target_modules: ["q_proj", "v_proj"]
lora_dropout: 0.005
bias: none

Training results

Step	Training Loss	Validation Loss
1000	0.240200	0.251211
2000	0.178700	0.210411
3000	0.150000	0.193197
4000	0.122500	0.184060
5000	0.122300	0.177079
6000	0.097100	0.181073
7000	0.095800	0.175566
8000	0.071400	0.173997
9000	0.082600	0.175677
10000	0.064400	0.178262
11000	0.064700	0.177943
12000	0.046900	0.185763
13000	0.047200	0.186843
14000	0.037500	0.193575
15000	0.036000	0.199084
16000	0.027500	0.208745
17000	0.025200	0.215685
18000	0.017400	0.227938
19000	0.016500	0.236160
20000	0.013000	0.240447

Framework versions

Transformers 4.40.2
Pytorch 2.6.0+cu124
Datasets 3.5.1
Tokenizers 0.19.1
Peft 0.10.0

banglabridge/base-bn-lora-adapter

Whisper Base Bn LoRA Adapter - by BanglaBridge

Training hyperparameters

Training results

Framework versions

banglabridge/
base-bn-lora-adapter