This is a merge of pre-trained language models created using
mergekit.
This model was merged using the
TIES merge method using
tinycompany/SigmaBoi-Instruct-nomic as a base.
1models:
2 - model: tinycompany/SigmaBoi-Instruct-nomic
3 # no parameters necessary for base model
4 - model: tinycompany/Tamed-Sigma-hi
5 parameters:
6 density: 0.5
7 weight: 0.5
8 - model: tinycompany/Tamed-Sigma
9 parameters:
10 density: 0.5
11 weight: 0.3
12merge_method: ties
13base_model: tinycompany/SigmaBoi-Instruct-nomic
14parameters:
15 normalize: true
16 weight: 0.3
17dtype: bfloat16
18
