This is a merge of pre-trained language models created using
mergekit.
This model was merged using the
Arcee Fusion merge method using
Novaciano/Kali-3.2-1B as a base.
1dtype: float32
2out_dtype: bfloat16
3merge_method: arcee_fusion
4base_model: Novaciano/Kali-3.2-1B
5models:
6 - model: Novaciano/Kali-3.2-1B
7 parameters:
8 weight:
9 - filter: mlp
10 value: [1, 2]
11 - value: 1
12 - model: Novaciano/SEX_ROLEPLAY_V3-3.2-1B
13 parameters:
14 weight:
15 - filter: lm_head
16 value: 1
17 - value: [1, 0.5]