scream_non_large_3e06_beams5_v2

• step: 29999
• eval_loss: 1.2308
• train_loss: 0.2858
• eval_wer: 10.3228
• eval_cer: 5.6236

Model description

Intended uses & limitations

Training and evaluation data

Training procedure

Training hyperparameters

• learning_rate: 3e-06
• lr_scheduler_type: linear
• per_device_train_batch_size: 5
• total_train_batch_size_per_node: 20
• total_train_batch_size: 160
• total_optimization_steps: 30,000
• starting_optimization_step: None
• finishing_optimization_step: 30,000
• num_train_dataset_workers: 32
• numb_hosts: 8
• total_num_training_examples: 4,800,000
• steps_per_epoch: 8543
• num_beams: 5

Training results

Framework versions

• Transformers 4.29.0.dev0
• Datasets 2.11.0
• Tokenizers 0.13.3