Q8BERTA-v2 is an optimised version of the orginal Q8BERTA which is first language model specifically trained on Kuwaiti dialect text. This model was pre-trained on datasets collected from various sources such as several social medias platforms, websites, and books. The model was optimized by training it on extra 20 epochs, so the total epochs it was trained on is 40 epochs.
BibTex If you utilize the Q8BERT model in your scientific publication, or if you find the resources in this repository beneficial, please cite our paper using the following details (citation information to be updated):
