Mistral-7B-Merge-14-v0.3-ft-step-9984 – AI Model by EmbeddedLLM | AlphaNeural AI

You can deploy this model and start earning money today!

Model Description

This is fine-tuned model based on EmbeddedLLM/Mistral-7B-Merge-14-v0.3 for 9984 steps.

The dataset used are:

dophin
dolphin-coder
Magicoder-OSS-Instruct-75K
openhermes
Synthia-v1.3

Chat Template

Prompt format: This model uses ChatML prompt format.

<|im_start|>system
You are Dolphin, a helpful AI assistant.<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant

Training

The model is scheduled to be fine-tuned for 3 epochs on 4 A100s using axolotl.

Shout-Out to OSS

Thank you to the Open Source AI community for bringing together marvelous code frameworks and datasets.