Model trained for RP conversation on Miqu-70B with our magic sauce.
Then, we have done a MoE, made of MiquMaid-v2-70B and Miqu-70B base, making the model using the finetune AND the base model for each token, working together.
We have seen a significant improvement, so we decided to share that, even if the model is very big.
Credits:
Undi
IkariDev
Description
This repo contains FP16 files of MiquMaid-v2-2x70B.