distilbert-base-25lang-cased
We are sharing smaller versions of
distilbert-base-multilingual-cased that handle a custom number of languages.
Our versions give exactly the same representations produced by the original model which preserves the original accuracy.
Handled languages: en, fr, es, de, zh, ar, ru, vi, el, bg, th, tr, hi, ur, sw, nl, uk, ro, pt, it, lt, no, pl, da and ja.
How to use
1from transformers import AutoTokenizer, AutoModel
2
3tokenizer = AutoTokenizer.from_pretrained("Geotrend/distilbert-base-25lang-cased")
4model = AutoModel.from_pretrained("Geotrend/distilbert-base-25lang-cased")
5
To generate other smaller versions of multilingual transformers please visit
our Github repo.
How to cite
1@inproceedings{smallermbert,
2 title={Load What You Need: Smaller Versions of Multilingual BERT},
3 author={Abdaoui, Amine and Pradel, Camille and Sigel, Grégoire},
4 booktitle={SustaiNLP / EMNLP},
5 year={2020}
6}
Contact
Please contact
amine@geotrend.fr for any question, feedback or request.
