I made this model as an experiment for /r/LocalLlama, who've all wanted a Yi graft like Goliath.
I took the goliath-120B template and used the same proportions to blend Tess-M-v1.3 and Tess-M-v1.2. The mergekit yaml is in the repo.
I chose these two as there are still precious few Yi-200K tunes and merging models with different ideas of positional encoding did not work well.
Thanks to Meta for Llama which kickstarted open weight models, thanks to Yi for the base model, thanks migtissera and the others who have fine-tuned Yi. Special shoutout to chargoddard for mergekit and the original frankenllama.
