Views
No views yet
1models:
2 - model: Francois-PE-12B
3 parameters:
4 weight: 0.3
5 density: 0.4
6 - model: Nera_Noctis-12B
7 parameters:
8 weight: 0.3
9 density: 0.4
10 - model: BlueLight-12B
11 parameters:
12 weight: 0.5
13 density: 0.8
14base_model: Mistral-Nemo-Base-2407
15parameters:
16 lambda: 1.0
17 epsilon: 0.1
18 rescale: true
19 normalize: false
20 int8_mask: true
21merge_method: della_linear
22tokenizer:
23 source: union
24dtype: bfloat16