Quantization made by Richard Erkhov.
This model is a fine-tuned 7B parameter LLM on the Intel Gaudi 2 processor from the
Intel/neural-chat-7b-v3-1 on the
meta-math/MetaMathQA dataset. The model was aligned using the Direct Performance Optimization (DPO) method with
Intel/orca_dpo_pairs. The
Intel/neural-chat-7b-v3-1 was originally fine-tuned from
mistralai/Mistral-7B-v-0.1. For more information, refer to our blog
The Practice of Supervised Fine-tuning and Direct Preference Optimization on Intel Gaudi2.
Here is the sample code to reproduce the model:
Sample Code.
1### System:
2{system}
3### User:
4{usr}
5### Assistant:
6
Detailed results can be found
here (
note: the leaderboard removed drop task)
neural-chat-7b-v3-3 can produce factually incorrect output, and should not be relied on to produce factually accurate information. Because of the limitations of the pretrained model and the finetuning datasets, it is possible that this model could generate lewd, biased or otherwise offensive outputs.
Therefore, before deploying any applications of neural-chat-7b-v3-3, developers should perform safety testing.
The license on this model does not constitute legal advice. We are not responsible for the actions of third parties who use this model. Please cosult an attorney before using this model for commercial purposes.
Detailed results can be found
here
