wav2vec 2.0 XLSR-53 Model

Preprocessing

1. Removal of symbols from transcript
2. Convert numbers (0, 1, ..., 9) to word forms (satu, dua, ..., sembilan)
3. Convert all characters to lowercase
4. Resample the audio data to 16kHz.
5. Uses data collator from this example

Hyperparameters used

• Learning rate = 1e-4
• Maximum Epochs = 30
• Batch size = 4 (limitations of compute resource)
• Early stopping = Stop when WER doesn't improve for 2 validations
• Other parameters use the defaults from this config

Results

References

• Fine-tuning XLS-R for Multi-Lingual ASR with 🤗 Transformers
• Wav2Vec2-Large-XLSR-Indonesian by Indonesian NLP