This is a merge of pre-trained language models created using
mergekit.
This model was merged using the
TIES merge method using
itorgov/dippy-roleplay-1739875661-0711603 as a base.
1base_model: itorgov/dippy-roleplay-1739875661-0711603
2dtype: float16
3merge_method: ties
4slices:
5- sources:
6 - layer_range: [0, 64]
7 model: itorgov/dippy-roleplay-1739875661-0711603
8 parameters:
9 density: [1.0, 0.7, 0.1]
10 weight: 1.0
11 - layer_range: [0, 64]
12 model: itorgov/dippy-roleplay-1739875662-172876
13 parameters:
14 density: 0.3
15 weight: 0.0001
