Beta
Explore
Marketplace
Neural Labs
Playground
Wallet
Docs
mT5-base-HunSum-2 – AI Model by SZTAKI-HLT | AlphaNeural AI
You can deploy this model and start earning money today!
SZTAKI-HLT
/
mT5-base-HunSum-2
like
0
transformers
pytorch
mt5
text2text-generation
summarization
hu
SZTAKI-HLT/HunSum-2-abstractive
google/mt5-base
finetune
apache-2.0
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Model Card for mT5-base-HunSum-2
The mT5-base-HunSum-2 is a Hungarian abstractive summarization model, which was trained on the
SZTAKI-HLT/HunSum-2-abstractive dataset
. The model is based on
google/mt5-base
.
Intended uses & limitations
Model type:
Text Summarization
Language(s) (NLP):
Hungarian
Resource(s) for more information:
GitHub Repo
Parameters
Batch Size:
12
Learning Rate:
5e-5
Weight Decay:
0.01
Warmup Steps:
3000
Epochs:
10
no_repeat_ngram_size:
3
num_beams:
5
early_stopping:
False
encoder_no_repeat_ngram_size:
4
Results
Metric
Value
ROUGE-1
40.06
ROUGE-2
12.67
ROUGE-L
25.93
