This repository provides a fine-tuned version of
ModernBERT, specifically adapted for masked language modeling with a
50% MASK ratio. The model is trained on instruction-following data, where approximately half of the tokens in the assistant's response are randomly masked. This approach encourages the model to effectively reconstruct missing information and generate coherent, contextually appropriate completions in dialogue settings.
