Views
No views yet
1merge_method: della_linear
2models:
3- model: PartAI/Dorna-Llama3-8B-Instruct
4 parameters:
5 weight: 0.5
6- model: meta-llama/Meta-Llama-3-8B-Instruct
7 parameters:
8 weight: 0.5
9parameters:
10 normalize: true
11 int8_mask: true
12 density: 0.5
13 lambda: 1.0
14 epsilon: 0.2
15dtype: bfloat16
16tokenizer:
17 source: union
18base_model: meta-llama/Meta-Llama-3-8B-Instruct
19write_readme: README.md
20