Model Description
This model is based on Whisper Large and was fine-tuned of transcribed upper sorbian speech. This is intended to contribute to the preservation of the Upper Sorbian language and can be freely used for language preservation projects in accordance with the license.
Note: This model is a snapshot from an ongoing fine-tuning session. Further (improved) versions of this will follow shortly.
Model Details
- Model Name: DL-whisper-large-hsb
- Model Version: 1.0.0
- Model Date: 2025-03-05
- Publisher:
- Architecture: Whisper Large
- License:
Training Details
Parameters:
- Learning rate: 6.25 x 10-⁶, linear decay
- Warmup: 1500 steps
- Additional: FP16 training
- Train batch size: 8
- Gradient accumulation step: 1
- Performance
Word Error Rate: 5.453
