Another attempt at merging Cerebrum, InfinityRP, LemonadeRP, and Laymonade, all already merged in my previous merges, now into a 9B containing TheSpice.
So far in my tests, it seems to follow my cards in intriguing way, using refined language, with more consideration of what the prompt is saying.
In fact, I'm quite positively surprised as the creativity surpassed my expectations. It's quickly becoming a favorite to use for me.
This is a merge of pre-trained language models created using
mergekit.
This model was merged using the passthrough merge method.
1slices:
2 - sources:
3 - model: ABX-AI/Cerebral-Infinity-7B
4 layer_range: [0, 20]
5 - sources:
6 - model: ABX-AI/Spicy-Laymonade-7B
7 layer_range: [12, 32]
8merge_method: passthrough
9dtype: float16
10