Model Card for Model ID
Model Details
Model Description
- Developed by: @afwull
- Model type: Multilanguage
- Language(s) (NLP): No language left behind languages
- Finetuned from model: facebook/nllb-200-3.3B
Uses
Tatar text detoxification.
Bias, Risks, and Limitations
Focused on internet at comments. Dataset bias shifts to political comments.
How to Get Started with the Model
Use the code below to get started with the model.
[More Information Needed]
Training Details
Training Data
Training Procedure
SFT Train
Loss: Cross-Entropy with label_smoothing=0.1
4 epochs
LR: 3e-4
Training Hyperparameters
Metrics
