The Mistral-7B-v0.1 Large Language Model (LLM) is a pretrained generative text model with 7 billion parameters.
This model uses peft finetuning with NEFTune for robustness.
This model is a finetuned model of the
mistralai/Mistral-7B-v0.1.
This model is finetuned with
kaist-ai/CoT-Collection.
This model trained with SFT trainer and
NEFTune method.
(According to the paper, NEFTune adds noise to the embedding vectors during training)
