Views
No views yet
1slices:
2 - sources:
3 - model: Undi95/Meta-Llama-3-8B-Instruct-hf
4 layer_range: [0, 24]
5 - sources:
6 - model: Undi95/Meta-Llama-3-8B-Instruct-hf
7 layer_range: [5, 28]
8 parameters:
9 scale:
10 - filter: o_proj
11 value: 0.0
12 - filter: down_proj
13 value: 0.0
14 - value: 1.0
15 - sources:
16 - model: Undi95/Meta-Llama-3-8B-Instruct-hf
17 layer_range: [28, 32]
18merge_method: passthrough
19dtype: bfloat16