Views
No views yet
1models:
2 - model: google/gemma-2b
3 parameters:
4 density: 0.5
5 weight: 0.5
6 - model: google/gemma-2b-it
7 parameters:
8 density: 0.5
9 weight: 0.5 # weight gradient
10merge_method: ties
11base_model: google/gemma-2b
12parameters:
13 normalize: true
14 int8_mask: true
15dtype: bfloat16
16