This model is finetuned to predict Rosetta fold energy using a dataset of 300k protein sequences:
100k of 20AA, 100k of 40AA, and 100k of 60AA
The starting pretrained model is from ProtTrans, trained on 2.1 billion proteins from BFD.
It was trained on protein sequences using a masked language modeling (MLM) objective. It was introduced in
this paper and first released in
this repository.