Takalani Sesame (named after the South African version of Sesame Street) is a project that aims to promote the use of South African languages in NLP, and in particular look at techniques for low-resource languages to equalise performance with larger languages around the world.
1from transformers import AutoTokenizer, AutoModelWithLMHead
2
3tokenizer = AutoTokenizer.from_pretrained("jannesg/takalane_nbl_roberta")
4
5model = AutoModelWithLMHead.from_pretrained("jannesg/takalane_nbl_roberta")
Updates will be added continously to improve performance. This is a very low resource language, results may be poor at first.
No preprocessing. Standard Huggingface hyperparameters.
