You can deploy this model and start earning money today!

vitthalbhandari/
xlsr-1b-aft-all-meh

Name: xlsr-1b-aft-all-meh
Availability: InStock

safetensors

wav2vec2

audio

automatic-speech-recognition

xlsr

adapter

meh

mozilla-foundation/common_voice_spontaneous_speech

cc-by-nc-4.0

Views

No views yet

XLS-R 1B Adapter Fine-tuned for Southwestern Tlaxiaco Mixtec

This model is a fine-tuned version of facebook/wav2vec2-xls-r-1b on the Mozilla Common Voice Spontaneous Speech dataset for Southwestern Tlaxiaco Mixtec (meh).

Training

Base model: facebook/wav2vec2-xls-r-1b
Fine-tuning method: Attention adapter layers (adapter_attn_dim=256)
Dataset: Mozilla Common Voice Spontaneous Speech

Usage

python

from transformers import Wav2Vec2ForCTC, Wav2Vec2Processor
import torch

processor = Wav2Vec2Processor.from_pretrained("vitthalbhandari/xlsr-1b-aft-all-meh")
model = Wav2Vec2ForCTC.from_pretrained("vitthalbhandari/xlsr-1b-aft-all-meh")

# Transcribe audio
inputs = processor(audio_array, sampling_rate=16000, return_tensors="pt")
with torch.no_grad():
    logits = model(**inputs).logits
predicted_ids = torch.argmax(logits, dim=-1)
transcription = processor.batch_decode(predicted_ids)