This model is the diffusion adapted TESS 2. This model is a simplex-based diffusion model adapted from Mistral v0.3 7B, further trained on Dolma 1.7.
For more details, please check out our paper
TESS-2: A Large-Scale, Generalist Diffusion Language Model.
This is the model based on Mistral v0.3.
This model will only work with our custom codebase found
here -- please go there to see details on how to run training.
If you find this work useful, please cite this work as follows.
1@misc{taeivison2025tess2,
2 title={{TESS 2: A Large-Scale Generalist Diffusion Language Model}},
3 author={Jaesung Tae and Hamish Ivison and Sachin Kumar and Arman Cohan},
4 year={2025},
5 eprint={2502.13917},
6 archivePrefix={arXiv},
7 primaryClass={cs.CL},
8 url={https://arxiv.org/abs/2502.13917},
9 }
