ConMamba-small-es
Table of Contents
Click to expand
Summary
The ConMamba-small-es is an acoustic model for Automatic Speech Recognition (ASR) in Spanish. It is based on the ConMamba architecture, which uses a Mamba (State Space Model) encoder augmented with convolutions for efficient sequence processing.
Model Description
The ConMamba-small-es model implements the Convolution-augmented Mamba (ConMamba) architecture, an adaptation of State Space Models (SSMs) designed to improve performance and efficiency in speech recognition tasks by integrating convolutional layers.
This model has been specifically trained for the Spanish language. The corpus used for training has 2788 hours, which consists of audio transcripts from television and radio broadcasts.
Intended Uses and Limitations
This model can be used for Automatic Speech Recognition (ASR) in Spanish. The model is intended to transcribe audio files in Spanish to plain text without punctuation.
How to Get Started with the Model
Installation
The implementation of the ConMamba architecture often depends on specific libraries such as mamba-ssm and causal-conv1d. It is recommended to follow the installation steps from the original Mamba ASR repository:
- Create a virtual environment (mamba_asr, for example):
1conda create --name mamba_asr python=3.9
2conda activate mamba_asr
- Install dependencies:
1clone github https://github.com/langtech-bsc/ConMamba_ASR
2cd ConMamba_ASR
3pip install -r requirements.txt
4# Make sure that the versions of torch, torchaudio, causal-conv1d, and mamba-ssm are compatible with your hardware.
For Inference
Inference is performed using the dedicated run_inference.py script provided within the repository.
- Define Paths: Set the paths for the repository, the input audio, and the specific configuration file for inference.
- Execute Inference: Run the script using the defined paths.
1# Define your paths
2REPO_PATH="/path/to/ConMamba-ASR"
3AUDIO="/path/to/your/audio.wav"
4HPARAMS="conmambamamba_debug_spanish_small_1k_unigram_inference.yaml" # Use your specific inference YAML
5
6# Execute inference script
7python $REPO_PATH/run_inference.py \
8 --hparams $HPARAMS \
9 --audio $AUDIO
Dev Result - WER: 12.52
Training Details
Training data
The model was trained for a total of 2788 hours. Including:
Training Hyperparameters
- Training hours: 2788
- language: Spanish
- number_of_epochs: 110
- batch_size: 30
- ctc_weight: 0.6
- grad_accumulation_factor: 1
- max_grad_norm: 5.0
- loss_reduction: 'batchmean'
- sorting: random
- num_workers: 8
- precision: bf16
- avg_checkpoints: 10
- lr_adam: 0.001
Citation
If this model contributes to your research, please cite the work:
1@inproceedings{zevallos2026conmambasmalles,
2 title={Evaluating High-Performance and Lightweight ASR Systems for Spanish},
3 author={Zevallos, Rodolfo}
4 organization={Barcelona Supercomputing Center},
5 year={2026}
6}
Additional Information
Author
Contact
For further information, please send an email to
bsc-lt@bsc.es.
Copyright
Copyright(c) 2026 by Language Technologies Laboratory, Barcelona Supercomputing Center.
License
Funding
This work is funded by the Ministerio para la Transformación Digital y de la Función Pública - Funded by EU – NextGenerationEU within the framework of the project Desarrollo de Modelos ALIA.
The conversion of the model was possible thanks to the computing time provided by
Barcelona Supercomputing Center through MareNostrum 5.
