A
mergekit frankenmerge based on
NeverSleep/MiquMaid-v1-70B with interleaved layers of
Sao10K/WinterGoddess-1.4x-70B-L2.
This was the top performing model from a series of merge experiments to create a highly coherant creative writing model.
Tests consisted of a series of private benchmarks and manual comparisons. A number of different base models, interleave models and layer offsets were compared.
Non frankenstein miqu-1 finetunes generally outperform their frankenstein counterparts at very long contexts due to coherency loss.
As a rough suggestion I might suggest swapping out to either
NeverSleep/MiquMaid-v1-70B or
152334H/miqu-1-70b-sf after 16k context.
No license. Component models based on the
Mistral AI Miqu-1 llama2 finetune that was released without license.
Exllamav2 quants will be available when bandwidth permits.
