You can deploy this model and start earning money today!

Deok-gi/
longformer-bert-base-4096

Name: longformer-bert-base-4096
Availability: InStock

Views

No views yet

longformer-bert-base-4096

longformer-bert-base-4096 is a model that started from the BERT checkpoint and was pretrained for MLM on long documents. It supports sequences of length up to 4,096.

Citing

If you use Longformer in your research, please cite Longformer: The Long-Document Transformer.

@article{Beltagy2020Longformer,
  title={Longformer: The Long-Document Transformer},
  author={Iz Beltagy and Matthew E. Peters and Arman Cohan},
  journal={arXiv:2004.05150},
  year={2020},
}

Longformer is an open-source project developed by the Allen Institute for Artificial Intelligence (AI2). AI2 is a non-profit institute with the mission to contribute to humanity through high-impact AI research and engineering.

Deok-gi/longformer-bert-base-4096

longformer-bert-base-4096

Citing

Deok-gi/
longformer-bert-base-4096