Views
No views yet
1base_model: meta-llama/Meta-Llama-3-8B
2dtype: bfloat16
3merge_method: ties
4parameters:
5 int8_mask: 1.0
6 normalize: 1.0
7slices:
8- sources:
9 - layer_range: [0, 32]
10 model: meta-llama/Meta-Llama-3-8B
11 - layer_range: [0, 32]
12 model: meta-llama/Meta-Llama-3-8B-Instruct
13 parameters:
14 density:
15 - value: 0.5
16 weight:
17 - value: 0.5
18tokenizer_source: union