Views
No views yet
| Task | Task Type | RoBERTa-base | BioMed-RoBERTa-base |
|---|---|---|---|
| RCT-180K | Text Classification | 86.4 (0.3) | 86.9 (0.2) |
| ChemProt | Relation Extraction | 81.1 (1.1) | 83.0 (0.7) |
| JNLPBA | NER | 74.3 (0.2) | 75.2 (0.1) |
| BC5CDR | NER | 85.6 (0.1) | 87.8 (0.1) |
| NCBI-Disease | NER | 86.6 (0.3) | 87.1 (0.8) |
1@inproceedings{domains,
2 author = {Suchin Gururangan and Ana Marasović and Swabha Swayamdipta and Kyle Lo and Iz Beltagy and Doug Downey and Noah A. Smith},
3 title = {Don't Stop Pretraining: Adapt Language Models to Domains and Tasks},
4 year = {2020},
5 booktitle = {Proceedings of ACL},
6}