Borealis-10.7B is a 10.7B model made of 48 Mistral 7B layers, finetuned for +70h on 2xA6000 on a big RP and Conversational dataset with llama2 configuration of Axolotl, like SOLAR.
Next step would be to do a DPO train on top, but I don't know if it would be benefical.
Description
This repo contains fp16 files of Borealis-10.7B, a conversational model.
The goal of this model isn't to break all benchmark, but to have a better RP/ERP/Conversational model.
It was trained on multiple basic dataset to make it intelligent, but majority of the dataset was basic conversations.
