whisper-small-informal-arabic-noaugmentation – AI Model by Talyiamira | AlphaNeural AI

You can deploy this model and start earning money today!

Talyiamira/
whisper-small-informal-arabic-noaugmentation

like

0

automatic-speech-recognition

generated_from_trainer

openai/whisper-small

endpoints_compatible

Views

No views yet

Whisper Small Informal Arabic (No augmentation)

This model is a fine-tuned version of openai/whisper-small on the Informal Arabic dataset. It achieves the following results on the evaluation set:

Loss: 0.7355
Wer: 35.7845
Cer: 11.7237

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 1e-05
train_batch_size: 16
eval_batch_size: 8
seed: 42
optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
lr_scheduler_type: linear
lr_scheduler_warmup_steps: 500
training_steps: 5000
mixed_precision_training: Native AMP

Training results

Training Loss	Epoch	Step	Validation Loss	Wer	Cer
0.1852	13.1579	500	0.5350	38.3517	13.5387
0.0035	26.3158	1000	0.6154	36.2284	11.9937
0.0014	39.4737	1500	0.6649	35.4127	11.5945
0.0004	52.6316	2000	0.7032	35.4726	11.6321
0.0003	65.7895	2500	0.7355	35.7845	11.7237

Framework versions

Transformers 4.50.3
Pytorch 2.6.0+cu124
Datasets 3.5.0
Tokenizers 0.21.1