This is a merge of pre-trained language models created using
mergekit.
This model was merged using the sce merge method using deepseek-r1-distill-llama-70b as a base.
Note: forcing the llama3.3 chat template can sometimes yield better results. The deepseek chat template is the default provided in config.
1models:
2 # Pivot model
3 - model: llama-3.3-70b-instruct
4 # Target models
5 - model: Sao10K/70B-L3.3-Cirrus-x1
6 - model: TheDrummer/Nautilus-70B-v0.1
7 - model: Doctor-Shotgun/L3.3-70B-Magnum-v4-SE
8 - model: SicariusSicariiStuff/Negative_LLAMA_70B
9merge_method: sce
10base_model: deepseek-ai/DeepSeek-R1-Distill-Llama-70B
11parameters:
12 select_topk: 1.0
13dtype: bfloat16
14