This model is the instruction-tuned TESS 2. This model is a simplex-based diffusion model adapted from Mistral v0.1 7B, further trained on Dolma 1.7 and Tulu 2 SFT data.
For more details, please check out our paper
TESS-2: A Large-Scale, Generalist Diffusion Language Model.
This is the model based on Mistral v0.1 and Tulu 2.
This model will only work with our custom codebase found
here -- please go there to see details on how to run training and inference.
Then, after creating a python environment with the correct packages, you can run inference via a ui with:
This allows you to directly interact with the model, and shows the diffusion generation process.
For training or other evaluations, please see our main repository.
If you find this work useful, please cite this work as follows.
1@misc{taeivison2025tess2,
2 title={{TESS 2: A Large-Scale Generalist Diffusion Language Model}},
3 author={Jaesung Tae and Hamish Ivison and Sachin Kumar and Arman Cohan},
4 year={2025},
5 eprint={2502.13917},
6 archivePrefix={arXiv},
7 primaryClass={cs.CL},
8 url={https://arxiv.org/abs/2502.13917},
9 }
