Compare between BERT-base and RoBERTa.
The models bert-base-chinese and hf1/Chinese-roberta-wwm-ext are built on the BERT and RoBERTa architectures, respectively.
Notably, hf1/Chinese-roberta-wwm-ext is based on the RoBERTa framework and boasts a larger model size, with 355 million parameters, in contrast to the 110 million parameters of bert-base-chinese.
During training, hf1/Chinese-roberta-wwm-ext-large utilized a more extensive and diverse set of articles, including web pages, news articles, and social media content.