Awarded 2nd place for Continued Pre-training of LLM on Legal Contracts - LLM Domain Adaptation project at Summer School on NLP, IIIT Hyderabad.
Slide deck of the presentation is linked
here.
This mistral model was trained 2x faster with
Unsloth and Huggingface's TRL library.