This is a merge of pre-trained language models created using
mergekit.
This model was merged using the
SLERP merge method.
1base_model: SicariusSicariiStuff/Assistant_Pepe_8B
2architecture: MistralForCausalLM
3merge_method: slerp
4dtype: float32
5out_dtype: bfloat16
6slices:
7 - sources:
8 - model: EldritchLabs/Cthulhu-8B-v1.4
9 layer_range: [0, 32]
10 - model: SicariusSicariiStuff/Assistant_Pepe_8B
11 layer_range: [0, 32]
12parameters:
13 t: 0.5
14tokenizer:
15source: union
16#chat_template: auto