Milasha is my 3rd and final series with Llama 3.1.
L3.1-70b-Milasha is a merge of the following models using
LazyMergekit running on a server:
This model kinda returns to tradition of merging the best models. MeowMix was used as language reinforcement for CJK while the rest of the models are more or less from the first in the series.
Llama 3 Instruct.
As I'm writing this, I'm overseas waiting for beef to arrive at my table. I'll probably finish writing this up properly later.
This model uses model stock. The rest just refer to the merge config file.
