iceman2434/

roberta-tagalog-base-ft-udpos213-top5langrandom

Model Specification

• Model: RoBERTa Tagalog Base (Jan Christian Blaise Cruz)
• Randomized training order of languages
• Training Data:
  • Combined English, Serbian, Slovenian, Naija, & Manx-Cadhan corpora (Top 5 Languages)
• Training Details:
  • Base configurations with learning rate 5e-5

Evaluation

• Evaluation Dataset: Universal Dependencies Tagalog Ugnayan (Testing Set)
• Tested in a zero-shot cross-lingual scenario on a Universal Dependencies Tagalog Ugnayan testing dataset (with 72.52% Accuracy)

POS Tags

• ADJ – ADP – ADV – CCONJ – DET – INTJ – NOUN – NUM – PART – PRON – PROPN – PUNCT – SCONJ – VERB