This is a merge of pre-trained language models created using
mergekit.
This model was merged using the
DARE TIES merge method using
Qwen/Qwen2.5-14B-Instruct as a base.
1merge_method: dare_ties
2base_model: Qwen/Qwen2.5-14B-Instruct
3tokenizer_source: union
4parameters:
5 density: 0.5
6 weight: 1.0
7models:
8 - model: kainatq/kairos_14b_v1_m4_robust
9 parameters:
10 weight: 0.6
11 - model: kainatq/kairos_14b_v1_m2_creative
12 parameters:
13 weight: 0.5
14 - model: Qwen/Qwen2.5-14B-Instruct
15 parameters:
16 weight: 0.4
