iceman2434/

xlm-roberta-base-ft-udpos213-top5lang

Model Specification

• Model: XLM-RoBERTa (base-sized model)
• Training Data:
  • Combined Afrikaans, Hebrew, Bulgarian, Vietnamese, & Norwegian corpora (Top 5 Languages)
• Training Details:
  • Base configurations with learning rate 5e-5

Evaluation

• Evaluation Dataset: Universal Dependencies Tagalog Ugnayan (Testing Set)
• Tested in a zero-shot cross-lingual scenario on a Universal Dependencies Tagalog Ugnayan testing dataset (with 76.34% Accuracy)

POS Tags

• ADJ – ADP – ADV – CCONJ – DET – INTJ – NOUN – NUM – PART – PRON – PROPN – PUNCT – SCONJ – VERB