This is a merge of pre-trained language models created using
mergekit.
This model was merged using the
TIES merge method using ArliAI/Mistral-Small-24B-ArliAI-RPMax-v1.4 as a base.
1models:
2 - model: ArliAI/Mistral-Small-24B-ArliAI-RPMax-v1.4
3 parameters:
4 density: 0.7
5 weight: 0.7
6 - model: TheDrummer/Cydonia-24B-v2
7 parameters:
8 density: 0.5
9 weight: 0.5
10 - model: OddTheGreat/Machina_24B.V2
11 parameters:
12 density: 0.3
13 weight: 0.3
14merge_method: ties
15base_model: ArliAI/Mistral-Small-24B-ArliAI-RPMax-v1.4
16parameters:
17 normalize: false
18 int8_mask: true
19dtype: bfloat16
20
