This is a merge of pre-trained language models created using
mergekit.
This model was merged using the passthrough merge method.
1dtype: float16
2merge_method: passthrough
3slices:
4- sources:
5 - layer_range: [0, 32]
6 model:
7 model:
8 path: meta-llama/Meta-Llama-3-8B-Instruct
9- sources:
10 - layer_range: [0, 32]
11 model:
12 model:
13 path: meta-llama/Meta-Llama-3-8B-Instruct
14- sources:
15 - layer_range: [0, 32]
16 model:
17 model:
18 path: meta-llama/Meta-Llama-3-8B-Instruct
19- sources:
20 - layer_range: [0, 32]
21 model:
22 model:
23 path: meta-llama/Meta-Llama-3-8B-Instruct
