Views
No views yet
1# Task Arithmetic - Grid Search
2# Weights: 0.6, 0.2
3base_model: Qwen/Qwen2.5-7B
4models:
5 - model: Qwen/Qwen2.5-Math-7B-Instruct
6 parameters:
7 weight: 0.6
8 - model: Qwen/Qwen2.5-Coder-7B-Instruct
9 parameters:
10 weight: 0.2
11merge_method: task_arithmetic
12parameters:
13 normalize: false
14 lambda: 1.0
15dtype: float16
16tokenizer:
17 source: union
18