https://ko-fi.com/ogodwin10
If you like this model, please give me some sponsorship and I will continue to create better merges. If there is a device that can fine-tune the model, there will be more new models fine-tuned after the merge (just like solar 10b).
This is a merge of pre-trained language models created using
mergekit.
This model was merged using the
TIES merge method using
EVA-UNIT-01/EVA-Qwen2.5-32B-v0.2 as a base.
1models:
2 - model: Qwen/QwQ-32B-Preview
3 parameters:
4 density: 1
5 weight: 1
6 - model: Qwen/Qwen2.5-Coder-32B-Instruct
7 parameters:
8 density: 1
9 weight: 1
10
11 - model: EVA-UNIT-01/EVA-Qwen2.5-32B-v0.2
12 parameters:
13 density: 1
14 weight: 1
15
16 - model: Qwen/QwQ-32B-Preview
17 parameters:
18 density: 1
19 weight: 1
20
21 - model: Qwen/Qwen2.5-Coder-32B-Instruct
22 parameters:
23 density: 1
24 weight: 1
25
26 - model: EVA-UNIT-01/EVA-Qwen2.5-32B-v0.2
27 parameters:
28 density: 1
29 weight: 1
30
31merge_method: ties
32base_model: EVA-UNIT-01/EVA-Qwen2.5-32B-v0.2
33parameters:
34 normalize: false
35 int8_mask: true
36dtype: bfloat16
37
