This is a merge of pre-trained language models created using
mergekit.
In my short testing so far, I think it's
slightly more aware of what's in the past and what it's instructed to do, but the
response format is not very consistent. Though, this might be because of my testing temp or bad instructions.
You can go up until temp 2 with this boy (just like it predecessor
v0.1), but it
will not satisfy you, because it'll spew out some old english in a modern way kind of thing.
Anyway, tweak the preset all you want in ST (the harmless ones), it will still able to respond correctly. Use preset in
v0.1 if not.
This model was merged using the
TIES merge method using
RozGrov/NemoDori-v0.2-12B-MN-BT as a base.
1
2models:
3 - model: crestf411/nemo-sunfall-v0.6.1
4 parameters:
5 weight: 0.22
6 - model: UsernameJustAnother/Nemo-12B-Marlin-v5
7 parameters:
8 weight: 0.22
9 - model: unsloth/Mistral-Nemo-Instruct-2407
10 parameters:
11 weight: 0.22
12 - model: RozGrov/NemoDori-v0.2-12B-MN-BT
13 parameters:
14 weight: 0.9
15merge_method: ties
16base_model: RozGrov/NemoDori-v0.2-12B-MN-BT
17parameters:
18 density: 0.93
19dtype: bfloat16
20