ConMamba-small-ca-
Table of Contents
Click to expand
Summary
The ConMamba-small-ca is an acoustic model for Automatic Speech Recognition (ASR) in Catalan. It is based on the ConMamba architecture, which uses a Mamba (State Space Model) encoder augmented with convolutions for efficient sequence processing.
Model Description
The ConMamba-small-ca model implements the Convolution-augmented Mamba (ConMamba) architecture, an adaptation of State Space Models (SSMs) designed to improve performance and efficiency in speech recognition tasks by integrating convolutional layers.
This model has been specifically trained for the Catalan language. The corpus used for training has 4929 hours.
Intended Uses and Limitations
This model can be used for Automatic Speech Recognition (ASR) in Catalan. The model is intended to transcribe audio files in Catalan to plain text without punctuation.
How to Get Started with the Model
Installation
The implementation of the ConMamba-small-ca architecture often depends on specific libraries such as mamba-ssm and causal-conv1d. It is recommended to follow the installation steps from the original Mamba ASR repository:
- Create a virtual environment (mamba_asr, for example):
1conda create --name mamba_asr python=3.9
2conda activate mamba_asr
- Install dependencies:
1clone github https://github.com/langtech-bsc/ConMamba_ASR
2cd ConMamba_ASR
3pip install -r requirements.txt
4# Make sure that the versions of torch, torchaudio, causal-conv1d, and mamba-ssm are compatible with your hardware.
For Inference
Inference is performed using the dedicated run_inference.py script provided within the repository.
- Define Paths: Set the paths for the repository, the input audio, and the specific configuration file for inference.
- Execute Inference: Run the script using the defined paths.
1# Define your paths
2REPO_PATH="/path/to/ConMamba-ASR"
3AUDIO="/path/to/your/audio.wav"
4HPARAMS="conmambamamba_debug_catalan_small_1k_unigram_inference.yaml" # Use your specific inference YAML
5
6# Execute inference script
7python $REPO_PATH/run_inference.py \
8 --hparams $HPARAMS \
9 --audio $AUDIO
Dev Result - WER: 8.6
Training Details
Training data
The model was trained for a total of 4929 hours. Including:
- Parlament-Parla-v3 (Only the anonymized version of the dataset is public. We trained the model with the non-anonymized version.)
- Corts Valencianes (Only the anonymized version of the dataset is public. We trained the model with the non-anonymized version.)
- 3cat
- IB3 (The datasets will be made accessible shortly.)
- Common Voice ca 17 Benchmark
Training Hyperparameters
- Training hours: 4929
- language: catalan
- number_of_epochs: 110
- batch_size: 30
- ctc_weight: 0.6
- grad_accumulation_factor: 1
- max_grad_norm: 5.0
- loss_reduction: 'batchmean'
- sorting: random
- num_workers: 8
- precision: bf16
- avg_checkpoints: 10
- lr_adam: 0.001
Citation
If this model contributes to your research, please cite the work:
1@inproceedings{zevallos2025conmambasmallca,
2 title={Evaluating High-Performance and Lightweight ASR Systems for Catalan},
3 author={Zevallos, Rodolfo}
4 organization={Barcelona Supercomputing Center},
5 year={2025}
6}
Additional Information
Author
Contact
For further information, please send an email to
bsc-lt@bsc.es.
Copyright
Copyright(c) 2025 by Language Technologies Laboratory, Barcelona Supercomputing Center.
License
Funding
This work has been promoted and financed by the Generalitat de Catalunya through the
Aina project.
The conversion of the model was possible thanks to the computing time provided by
Barcelona Supercomputing Center through MareNostrum 5.
