A cursed experiment. You probably shouldn't use this unless you hate yourself...or are very open to trying new things. Exceptionally mediocre.
This is a merge of pre-trained language models created using
mergekit.
This model was merged using the
TIES merge method using
arcee-ai/Arcee-Blitz as a base.
1models:
2 - model: arcee-ai/Arcee-Blitz
3 - model: trashpanda-org/MS-24B-Mullein-v0
4 parameters:
5 density: 1
6 weight: 1
7merge_method: ties
8base_model: arcee-ai/Arcee-Blitz
9parameters:
10 normalize: true
11dtype: bfloat16
12