Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
ruRoBERTa-large-rucola – AI Model by RussianNLP | AlphaNeural AI
You can deploy this model and start earning money today!
RussianNLP
/
ruRoBERTa-large-rucola
like
0
transformers
pytorch
roberta
text-classification
ru
apache-2.0
autotrain_compatible
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
This is a finetuned version of
RuRoBERTa-large
for the task of linguistic acceptability classification on the
RuCoLA
benchmark.
The hyperparameters used for finetuning are as follows:
5 training epochs (with early stopping based on validation MCC)
Peak learning rate: 1e-5, linear warmup for 10% of total training time
Weight decay: 1e-4
Batch size: 32
Random seed: 5
Optimizer:
torch.optim.AdamW