Formosan ASR — Paiwan
This is FormosanBank's current general-purpose automatic speech recognition
checkpoint for Paiwan. It was selected by the lowest normalized
micro word error rate among the completed language-level TACL systems evaluated
on the same frozen all-corpora test partition.
Model
- Repository:
FormosanBank/formosan-asr-paiwan
- Architecture family: XLS-R 53
- Training path: language-pooled supervised fine-tuning
- Base model:
facebook/wav2vec2-large-xlsr-53
- Parameters are stored in
model.safetensors
Training lineage
- Base checkpoint:
facebook/wav2vec2-large-xlsr-53.
- Supervised ASR fine-tuning on the target language's pooled training corpora.
The target-language supervised stage used ILRDF, NTU, Xuan, YeddaPalemeqBlog, Youtube, ePark1, ePark2, ePark3. The experiment used
dataset_v1, frozen split_v2, normalization formosan_safe_v1, and seed
13. Full machine-readable provenance is included in
training_config.json.
Evaluation
Evaluation uses the frozen, leakage-controlled split_v2 test manifests and
normalized text. Metrics are computed by summing edit counts across all
available Paiwan test corpora, so larger corpora contribute in
proportion to their reference tokens.
- Normalized micro WER: 42.31%
- Normalized micro CER: 15.08%
- Test utterances: 4,421
- Test corpora: 8
- Automated readiness: review
The automated readiness label is review, with zero hard failures. The retained warning is recorded in readiness_summary.json and should be considered when reproducing or promoting the checkpoint.
| Corpus | Utterances | WER | CER |
|---|
| ILRDF | 537 | 27.82% | 5.28% |
| NTU | 96 | 27.86% | 5.71% |
| Xuan | 7 | 24.00% | 5.60% |
| YeddaPalemeqBlog | 65 | 30.18% | 6.43% |
| Youtube | 1807 | 74.26% | 33.25% |
| ePark1 | 339 | 28.29% | 5.66% |
| ePark2 | 316 | 14.05% | 1.87% |
| ePark3 | 1254 | 20.98% | 4.44% |
Detailed edit counts are provided in evaluation_results.json and
metrics_by_corpus.tsv.
These figures are specific to the frozen TACL evaluation protocol. They should
not be compared directly with the April 2026 stage-one releases, which used a
different experiment snapshot.
Usage
1from transformers import pipeline
2
3repo_id = "FormosanBank/formosan-asr-paiwan"
4transcribe = pipeline("automatic-speech-recognition", model=repo_id)
5result = transcribe("path/to/16khz_audio.wav")
6print(result["text"])
For long recordings, segment the audio before inference. The training recipe
used utterances between 2 and 20 seconds.
Intended use
This checkpoint supports research, education, language documentation, and
revitalization work involving Paiwan. Human review is recommended
before using transcriptions in archives, publications, teaching materials, or
other consequential settings.
Limitations
Performance varies substantially across corpora, speakers, recording
conditions, dialects, speaking styles, and orthographic conventions. The
aggregate score can hide weak performance on a particular corpus. The model
may omit, substitute, or hallucinate words and should not be treated as an
authoritative transcription source.
Data provenance
Training and evaluation artifacts come from the frozen Hunter Formosan TACL
pipeline. Source corpus IDs can include Bible, ILRDF, NTU, ePark1, ePark2,
ePark3, Xuan, YeddaPalemeqBlog, Youtube, and YutasWilang, depending on language
availability. Audio is not redistributed in this repository. Underlying
recordings retain their original rights and access conditions.
License and attribution
This model release and FormosanBank annotations/metadata are provided under
CC BY 4.0. The upstream facebook/wav2vec2-large-xlsr-53 checkpoint is distributed under
Apache 2.0. Users remain responsible for respecting the terms associated with
underlying source recordings.
Please cite FormosanBank:
1@misc{mohamed2024formosanbank,
2 author = {Mohamed, W. and Le Ferrand, É. and Sung, L.-M. and Prud'hommeaux, E. and Hartshorne, J. K.},
3 title = {FormosanBank},
4 year = {2024},
5 note = {Electronic Resource},
6 url = {https://ai4commsci.gitbook.io/formosanbank}
7}