Llama3-Omphalos-12B is a merge of the following models using
LazyMergekit:
1dtype: bfloat16
2merge_method: passthrough
3slices:
4- sources:
5 - layer_range: [0, 8]
6 model: bluuwhale/L3-SthenoMaidBlackroot-8B-V1
7- sources:
8 - layer_range: [4, 12]
9 model: Casual-Autopsy/L3-Umbral-Mind-RP-v1.0-8B
10- sources:
11 - layer_range: [9, 16]
12 model: bluuwhale/L3-SthenoMaidBlackroot-8B-V1
13- sources:
14 - layer_range: [13, 20]
15 model: Casual-Autopsy/L3-Umbral-Mind-RP-v1.0-8B
16- sources:
17 - layer_range: [17, 24]
18 model: bluuwhale/L3-SthenoMaidBlackroot-8B-V1
19- sources:
20 - layer_range: [21, 28]
21 model: Casual-Autopsy/L3-Umbral-Mind-RP-v1.0-8B
22- sources:
23 - layer_range: [25, 32]
24 model: bluuwhale/L3-SthenoMaidBlackroot-8B-V1
