This is a merge of pre-trained language models created using
mergekit. Artbitrary update, because I know that people would request it. Didn't have much time to test it, tbh, but feels nice enough? It's up to y'all to decide if it's an upgrade, sidegrade or downgrade. At least now both models have ChatML trained, there's that.
Static GGUF (by Mradermacher)
Imatrix GGUF (by Mradermacher)
EXL2 (by kingbri of RoyalLab)
This model was merged using the
TIES merge method using
nothingiisreal/MN-12B-Celeste-V1.9 as a base.
1models:
2 - model: anthracite-org/magnum-12b-v2
3 parameters:
4 density: 0.3
5 weight: 0.5
6 - model: nothingiisreal/MN-12B-Celeste-V1.9
7 parameters:
8 density: 0.7
9 weight: 0.5
10
11merge_method: ties
12base_model: nothingiisreal/MN-12B-Celeste-V1.9
13parameters:
14 normalize: true
15 int8_mask: true
16dtype: bfloat16
17