image/png
This is a Mistral model with ChatML tokens added to the tokenizer.
This is a merge of pre-trained language models created using
mergekit.
This model was merged using the
SCE merge method using
shisa-ai/shisa-v2-mistral-nemo-12b as a base.
1base_model: shisa-ai/shisa-v2-mistral-nemo-12b
2models:
3 - model: Elizezen/Himeyuri-v0.1-12B
4 parameters:
5 weight: 1.0
6 - model: yamatazen/Himeyuri-Magnum-12B
7 parameters:
8 weight: 0.6
9 - model: inflatebot/MN-12B-Mag-Mell-R1
10 parameters:
11 weight: 0.3
12merge_method: sce
13dtype: bfloat16
14parameters:
15 normalize: true
16 select_topk: 0.5
17tokenizer:
18 source: union