You can deploy this model and start earning money today!

dariurs/
eduro-bert-romanian-fillblank-v3

Name: eduro-bert-romanian-fillblank-v3
Availability: InStock

masked-language-modeling

dariurs/EduRO-FillBlank

dumitrescustefan/bert-base-romanian-cased-v1

finetune

cc-by-sa-4.0

Views

No views yet

EduRO BERT v3 — Romanian Fill-in-the-Blank Model

Fine-tuned Romanian BERT for academic fill-in-the-blank question generation, trained on the EduRO-FillBlank dataset (72,541 examples from Romanian Wikipedia).

Training Details

Parameter	Value
Base model	dumitrescustefan/bert-base-romanian-cased-v1
Dataset	EduRO-FillBlank v2 (72,541 examples)
Epochs	10
Learning Rate	2e-5
Batch Size	8
MLM Probability	15%
Hardware	NVIDIA A100

Results

EduRO Test Set

Metric	Score
Acc@1	34.82%
Acc@5	56.65%
MRR	0.4482

Neutral Wikipedia Corpus (400 sentences, unseen)

Metric	Score
Acc@1	32.5%
Acc@5	55.2%
MRR	0.410

Usage

python

from transformers import pipeline

pipe = pipeline("fill-mask",
                model="dariurs/eduro-bert-romanian-fillblank-v3")

result = pipe("Fotosinteza este procesul [MASK] prin care plantele produc energie.")
print(result)

Citation

[to be added after paper publication]