Views
No views yet
1merge_method: dare_ties
2base_model: unsloth/DeepSeek-R1-Distill-Qwen-14B
3dtype: bfloat16
4
5models:
6 - model: kainatq/kainat-s-elite-14b-t1_m1
7 parameters:
8 weight: 0.8
9 density: 0.6 # Keep 60% of the changed parameters
10 dare_linear: true
11
12 - model: kainatq/kainat-s-elite-14b-t1_m2
13 parameters:
14 weight: 0.8
15 density: 0.6 # Keep 60% of the changed parameters
16 dare_linear: true
17
18parameters:
19 normalize: true
20 dare_density: 0.6
21 dare_epsilon: 0.08```