Views
No views yet
1slices:
2 - sources:
3 - model: mergekit-community/mergekit-model_stock-rxbbxes
4 layer_range: [0, 28]
5 - sources:
6 - model: mergekit-community/mergekit-model_stock-rxbbxes
7 layer_range: [5, 28]
8 parameters:
9 scale:
10 - filter: o_proj
11 value: 0.0
12 - filter: down_proj
13 value: 0.0
14 - value: 1.0
15 - sources:
16 - model: mergekit-community/mergekit-model_stock-rxbbxes
17 layer_range: [28, 32]
18merge_method: passthrough
19dtype: bfloat16