Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
xlm-roberta-longformer-base-16384 – AI Model by hyperonym | AlphaNeural AI
You can deploy this model and start earning money today!
hyperonym
/
xlm-roberta-longformer-base-16384
like
0
transformers
tf
longformer
feature-extraction
generated_from_keras_callback
multilingual
af
am
ar
as
az
be
bg
bn
br
bs
ca
cs
cy
da
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
xlm-roberta-longformer-base-16384
xlm-roberta-longformer is a multilingual
Longformer
initialized with
XLM-RoBERTa
's weights without further pretraining. It is intended to be fine-tuned on a downstream task.
Model
attention_window
hidden_size
num_hidden_layers
model_max_length
base
256
768
12
16384
large
512
1024
24
16384
Framework versions
Transformers 4.26.0
TensorFlow 2.11.0
Tokenizers 0.13.2
