This is a merge of pre-trained language models created using
mergekit.
An experimental merge of the legendary L3-8B-Stheno with Fizzarolli's Rosier. The aim is to improve Stheno's "ball-rolling" capabilities and reduce its awkwardness with more niche content.
For a first go, I'm surprised at how well it's doing so far, but given that this is literally my first LLM project ever, probably temper your expectations.
This model was merged using the
linear merge method.
1models:
2 - model: Sao10K/L3-8B-Stheno-v3.2
3 parameters:
4 weight: 0.5
5 - model: Fizzarolli/L3-8b-Rosier-v1
6 parameters:
7 weight: 0.5
8
9merge_method: linear
10parameters:
11 normalize: true
12dtype: float16
