You can deploy this model and start earning money today!

Rorch/
wav2vec2-finetuned

Name: wav2vec2-finetuned
Rating: 2.5 (5 reviews)

automatic-speech-recognition

generated_from_trainer

Osolon/wav2vec2-large-xls-r-300m-pl

finetune

apache-2.0

endpoints_compatible

Views

No views yet

wav2vec2-finetuned

This model is a fine-tuned version of Osolon/wav2vec2-large-xls-r-300m-pl on an unknown dataset. It achieves the following results on the evaluation set:

Loss: inf
Wer: 0.2842

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 0.0001
train_batch_size: 8
eval_batch_size: 2
seed: 42
gradient_accumulation_steps: 2
total_train_batch_size: 16
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
lr_scheduler_warmup_steps: 20
num_epochs: 4
mixed_precision_training: Native AMP

Training results

Training Loss	Epoch	Step	Validation Loss	Wer
0.2957	0.1238	400	inf	0.2624
0.2376	0.2476	800	inf	0.2041
0.1932	0.3713	1200	inf	0.1888
0.1572	0.4951	1600	inf	0.1530
0.1587	0.6189	2000	inf	0.1409
0.3076	0.7427	2400	inf	0.1530
0.3546	0.8665	2800	inf	0.4019
0.5404	0.9903	3200	inf	0.4470
0.46	1.1140	3600	inf	0.4020
0.3461	1.2378	4000	inf	0.3146
0.3177	1.3616	4400	inf	0.2379
0.318	1.4854	4800	inf	0.2700
0.2998	1.6092	5200	inf	0.2883
0.3068	1.7329	5600	inf	0.2842
0.3177	1.8567	6000	inf	0.2842
0.3098	1.9805	6400	inf	0.2842
0.3144	2.1043	6800	inf	0.2842
0.3133	2.2281	7200	inf	0.2842
0.2993	2.3518	7600	inf	0.2842
0.3037	2.4756	8000	inf	0.2842
0.3038	2.5994	8400	inf	0.2842
0.306	2.7232	8800	inf	0.2842
0.3239	2.8470	9200	inf	0.2842
0.2997	2.9708	9600	inf	0.2842
0.3118	3.0945	10000	inf	0.2842
0.3125	3.2183	10400	inf	0.2842
0.3175	3.3421	10800	inf	0.2842
0.3057	3.4659	11200	inf	0.2842
0.3053	3.5897	11600	inf	0.2842
0.3062	3.7134	12000	inf	0.2842
0.3137	3.8372	12400	inf	0.2842
0.3069	3.9610	12800	inf	0.2842

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu121
Datasets 2.21.0
Tokenizers 0.19.1

Rorch/wav2vec2-finetuned

wav2vec2-finetuned

Model description

Intended uses & limitations

Training and evaluation data

Training procedure

Training hyperparameters

Training results

Framework versions

Rorch/
wav2vec2-finetuned