You can deploy this model and start earning money today!

Jonandrop/
eurobert-lemma-en-210m

Name: eurobert-lemma-en-210m
Availability: InStock

EuroBERT/EuroBERT-210m

quantized

apache-2.0

Views

No views yet

English Lemmatizer (int8 ONNX)

Per-language lemmatizer and UPOS tagger fine-tuned from EuroBERT/EuroBERT-210m on UD English-EWT. Predicts an edit-tree label per token; applying it to the surface word yields the lemma. Dynamic-int8 quantized ONNX (~203 MB).

Accuracy (UD test, dynamic int8, valid-label masking ON)

Metric	int8	fp (reference)
Lemma accuracy	96.99%	96.99%
UPOS accuracy	96.62%	N/A

int8 trades accuracy for size; the fp16/torch model is several points higher (UPOS head is most affected by quantization).

CRITICAL: valid-label masking

Plain argmax over edit-tree labels often picks a label that is structurally invalid for the word (its delete-segment does not match), applying it fails and accuracy collapses. At inference you MUST iterate candidate labels in descending logit order and pick the first whose edit applies to the word (identity is the guaranteed fallback). This is model-internal selection, not a hand-written rule.

Files

model.int8.onnx: inputs input_ids, attention_mask; outputs upos_logits, lemma_logits
config.json, tokenizer.json, tokenizer_config.json, special_tokens_map.json
id2label.json / label2id.json: edit-tree lemma labels
upos_id2label.json / upos_label2id.json: UPOS labels
edit_trees.json: edit-tree label definitions
lexicon.json: fallback {word: lemma} lexicon

Jonandrop/eurobert-lemma-en-210m

English Lemmatizer (int8 ONNX)

Accuracy (UD test, dynamic int8, valid-label masking ON)

CRITICAL: valid-label masking

Files

Jonandrop/
eurobert-lemma-en-210m