GritLM is a generative representational instruction tuned language model. It unifies text representation (embedding) and text generation into a single model achieving state-of-the-art performance on both types of tasks.
| Model | Description |
|---|---|
| GritLM 7B | Mistral 7B finetuned using GRIT |
| GritLM 8x7B | Mixtral 8x7B finetuned using GRIT |
1@misc{muennighoff2024generative,
2 title={Generative Representational Instruction Tuning},
3 author={Niklas Muennighoff and Hongjin Su and Liang Wang and Nan Yang and Furu Wei and Tao Yu and Amanpreet Singh and Douwe Kiela},
4 year={2024},
5 eprint={2402.09906},
6 archivePrefix={arXiv},
7 primaryClass={cs.CL}
8}