This is a merge of pre-trained language models created through a multi-stage combination using
mergekit.
This model was merged using the
Arcee Fusion merge method.
1name: First
2architecture: MistralForCausalLM
3base_model: B:\12B\Vortex5--Ethereal-Stardust-12B
4models:
5 - model: B:\12B\Vortex5--Ethereal-Stardust-12B
6 - model: B:\12B\Vortex5--Wicked-Oblivion-12B
7merge_method: arcee_fusion
8parameters:
9 tukey_fence: 1.5
10dtype: float32
11out_dtype: bfloat16
12tokenizer:
13 source: B:\12B\Vortex5--Ethereal-Stardust-12B
14chat_template: auto
15---
16name: Wicked Moondust 12B
17architecture: MistralForCausalLM
18base_model: First
19models:
20 - model: First
21 - model: B:\12B\Vortex5--Nether-Moon-12B
22merge_method: arcee_fusion
23parameters:
24 tukey_fence: 1.5
25dtype: float32
26out_dtype: bfloat16
27tokenizer:
28 source: First
29chat_template: auto
