whisper-small-informal-arabic-new – AI Model by Talyiamira | AlphaNeural AI

You can deploy this model and start earning money today!

Talyiamira/
whisper-small-informal-arabic-new

like

0

automatic-speech-recognition

generated_from_trainer

openai/whisper-small

endpoints_compatible

Views

No views yet

Whisper Small Informal Arabic

This model is a fine-tuned version of openai/whisper-small on the Informal Arabic dataset. It achieves the following results on the evaluation set:

Loss: 0.7988
Wer: 35.7244
Cer: 13.7759

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 1e-05
train_batch_size: 16
eval_batch_size: 8
seed: 42
optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
lr_scheduler_type: linear
lr_scheduler_warmup_steps: 1000
training_steps: 5000
mixed_precision_training: Native AMP

Training results

Training Loss	Epoch	Step	Validation Loss	Wer	Cer
0.1677	4.6296	1000	0.5868	38.8724	15.6307
0.0075	9.2593	2000	0.6943	37.7629	15.0868
0.0009	13.8889	3000	0.7523	35.4793	13.7734
0.0007	18.5185	4000	0.7892	35.5180	13.7529
0.0003	23.1481	5000	0.7988	35.7244	13.7759

Framework versions

Transformers 4.49.0
Pytorch 2.5.1+cu118
Datasets 3.3.2
Tokenizers 0.21.0