This is a merge of pre-trained language models created using
mergekit.
This model was merged using the
TIES merge method using
MaziyarPanahi/Llama-3-8B-Instruct-v0.4 as a base.
1models:
2 - model: netcat420/MFANNv0.17.11
3 parameters:
4 density: [1, 0.7, 0.1] # density gradient
5 weight: 1.0
6 - model: netcat420/MFANNv0.17
7 parameters:
8 density: [1, 0.7, 0.1] # density gradient
9 weight: 1.0
10merge_method: ties
11base_model: MaziyarPanahi/Llama-3-8B-Instruct-v0.4
12parameters:
13 normalize: true
14 int8_mask: true
15dtype: float16
16
