DziriBERT is the first Transformer-based Language Model that has been pre-trained specifically for the Algerian Dialect. It handles Algerian text contents written using both Arabic and Latin characters.
This is a fine-tuned version that is ready to use for sentiment classification.
For more information, please visit our paper:
https://arxiv.org/pdf/2109.12346.pdf.
1from transformers import BertTokenizer, BertForSequenceClassification
2
3tokenizer = BertTokenizer.from_pretrained("alger-ia/dziribert_sentiment")
4model = BertForSequenceClassification.from_pretrained("alger-ia/dziribert_sentiment")
5
You can find a fine-tuning script in our Github repo:
https://github.com/alger-ia/dziribert1@article{dziribert,
2 title={DziriBERT: a Pre-trained Language Model for the Algerian Dialect},
3 author={Abdaoui, Amine and Berrimi, Mohamed and Oussalah, Mourad and Moussaoui, Abdelouahab},
4 journal={arXiv preprint arXiv:2109.12346},
5 year={2021}
6}
Please contact
amine.abdaoui.nlp@gmail.com for any question, feedback or request.
