This is a merge of pre-trained language models created using
mergekit.
This model was merged using the
DARE TIES merge method using
jeiku/Luna_3B as a base.
1models:
2 - model: jeiku/Luna_3B+jeiku/Humiliation_StableLM
3 parameters:
4 weight: 0.20
5 density: 1
6 - model: jeiku/Luna_3B+jeiku/Erotica_StableLM
7 parameters:
8 weight: 0.40
9 density: 1
10 - model: jeiku/Luna_3B+jeiku/Gnosis_StableLM
11 parameters:
12 weight: 0.35
13 density: 1
14merge_method: dare_ties
15base_model: jeiku/Luna_3B
16parameters:
17dtype: bfloat16
