Views
No views yet
1base_model:
2 model:
3 path: smelborp/MixtralOrochi8x7B
4dtype: bfloat16
5merge_method: dare_ties
6slices:
7- sources:
8 - layer_range: [0, 32]
9 model:
10 model:
11 path: ycros/BagelMIsteryTour-v2-8x7B
12 parameters:
13 density: 0.6
14 weight: 0.5
15 - layer_range: [0, 32]
16 model:
17 model:
18 path: NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO
19 parameters:
20 density: 0.4
21 weight: 0.25
22 - layer_range: [0, 32]
23 model:
24 model:
25 path: smelborp/MixtralOrochi8x7B