This is an experimental model that I made by merging two 2expmixtrals The mergekitty is a tool that lets me mix and match different models into one big model, keeping all the smarts and skills of the original models. The llama70b is a huge language model that can make words for all kinds of things and ways, based on the GPT-4 thingy.
The merged model has 19 billion parraraameters and was made trained on 640GB of vram cluster
Merge me baby one more time
Sending this contraption out straight to mergeland, would be hilarious if it gets 1st
