I took base llama 2 70b model and frankenmerged it with itself using mergekit. Somehow it is coherent.
Thanks for featuring me at https://merge.moe/. I'll try my best to make even more good(!?) merges in the future.
Observations
It is more creative than the base model and has a sense of humor.
Just like Goliath is sometimes makes new words without meaning.
Just like the base model, it is quite disobedient, clever prompting is needed to get it to output answers.
Should be great for storywriting.
Significantly better than the base model in stylized writing and poems. Still far away from finetuned models.
The way it comes back at its past mistakes and fails my tests is almost human. (After model failed the test, I haven't told it yet that it failed) Me: "Why did you pick that?" Dicephal: "Because I am an idiot."
