This model is trained off of Josephgflowers/TinyLlama-v1.1-Agent-Rag-Nerd-v1 which is trained off of the tinyllama v1.1. This model was trained using the tinyllama chat format, zephyr.
I trained this model using a vast amount of textbooks are all you need style synthetic datasets as well as some common chat datasets and the Cinder dataset.
