The new version of BERT v3.0 for Persian is available today and can tackle the zero-width non-joiner character for Persian writing. Also, the model was trained on new multi-types corpora with a new set of vocabulary.
ParsBERT is a monolingual language model based on Google’s BERT architecture. This model is pre-trained on large Persian corpora with various writing styles from numerous subjects (e.g., scientific, novels, news).
Paper presenting ParsBERT:
arXiv:2005.125151@article{ParsBERT,
2 title={ParsBERT: Transformer-based Model for Persian Language Understanding},
3 author={Mehrdad Farahani, Mohammad Gharachorloo, Marzieh Farahani, Mohammad Manthouri},
4 journal={ArXiv},
5 year={2020},
6 volume={abs/2005.12515}
7}
Post a Github issue on the
ParsBERT Issues repo.
