This model is an English language model based on ModernBERT-base, fine-tuned using verb examples from English Wiktionary via supervised contrastive learning.
The fine-tuning improves token-level semantic representations, particularly for tasks like Word-in-Context (WiC) and Word Sense Disambiguation (WSD).
Although trained on verbs, the model shows enhanced representation quality across the lexicon.
Developed by: Anna Mosolova, Marie Candito, Carlos Ramisch