Twitter-roBERTa-base fine-tuned using masked language modelling
This is a RoBERTa-base model finetuned (domain adaptation) on ~2M tweets from Jin 2009 (sentiment140).
This is the first step of a two steps approach to finetune for sentiment analysis (ULMFit)
This model is suitable for English.
Main charachetistics:
pretrained model and tokenizer: distillroberta-base