Views
No views yet
1# M3: DARE-TIES Merge (K3s11 0.5 + K3s77 0.5, density=0.8)
2# Equal weight blending of the two best K3 seeds
3# K3s11: ALF 64%, DB 52.92% (best ALF)
4# K3s77: ALF 60%, DB 53.95% (best DB)
5# Hypothesis: Equal weighting may find a sweet spot
6
7models:
8 - model: ./outputs/phase_k3s11/merged_model
9 parameters:
10 density: 0.8
11 weight: 0.5
12 - model: ./outputs/phase_k3s77/merged_model
13 parameters:
14 density: 0.8
15 weight: 0.5
16merge_method: dare_ties
17base_model: Qwen/Qwen2.5-7B-Instruct
18parameters:
19 normalize: true
20 int8_mask: true
21dtype: bfloat16
22