AlphaMonarch-7B is a DPO fine-tuned of
mlabonne/NeuralMonarch-7B using the
argilla/OpenHermes2.5-dpo-binarized-alpha preference dataset.
It is based on a merge of the following models using
LazyMergekit:
Special thanks to
Jon Durbin,
Intel,
Argilla, and
Teknium for the preference datasets.
This model uses a context window of 8k. I recommend using it with the Mistral Instruct chat template (works perfectly with LM Studio).
If you use SillyTavern, you might want to tweak the inference parameters. Here's what LM Studio uses as a reference: temp 0.8, top_k 40, top_p 0.95, min_p 0.05, repeat_penalty 1.1.
It is one of the very best 7B models in terms of instructing following and reasoning abilities and can be used for conversations, RP, and storytelling. Note that it tends to have a quite formal and sophisticated style, but it can be changed by modifying the prompt.
