temp
This is a merge of pre-trained language models created using
mergekit.
Merge Details
Merge Method
This model was merged using the NuSLERP merge method using
mlabonne/gemma-3-12b-it-abliterated as a base.
Well, it's been a while, hasn't it? It's only been a short 5 months since I posted the last Nemesia version, saying the famous last words
I will try swapping out a model or two in the merge and trying again to upload as a v2.0.
Then, exams and university stuff crushed me whole which wasn't great, and I didn't have any time or computational resources to get back to merging on a reasonable timeframe until now.
Honestly, in the time since, Qwen2.5-7B really has not turned out to be all that interesting, Mistral Nemo stealing most of its thunder. So, I decided to update my Nemesia mergeset with a
new base: Gemma3-12B! In my experience, it has been alright, so I'm excited to tinker with it.
In my testing, this thing is alright- I couldn't run any GGUFs of it since I don't even know what on earth has happened to my .venv in the 5 months past, I'm pretty sure my Transformers installation
is corrupted, and I'm re-cloning llama.cpp as I write this. I ran the FP16 and it seemed coherent enough, but I leave that to you to decide.
Uses all of the special NuSLERP options because they're there, and is based on the abliterated version of Gemma3 instead of the base because I <3 mlabonne.
Models Merged
The following models were included in the merge:
Configuration
The following YAML configuration was used to produce this model:
1models:
2 - model: mlabonne/gemma-3-12b-it-abliterated
3 parameters:
4 weight: 1.0
5 - model: qiuxi337/gemma-3-12b-it-grpo
6 parameters:
7 weight: 0.5
8 - model: google/gemma-3-12b-it
9 parameters:
10 weight: 0.2
11merge_method: nuslerp
12base_model: mlabonne/gemma-3-12b-it-abliterated
13parameters:
14 normalize: true
15 int8_mask: true
16 nuslerp_flatten: false
17 nuslerp_row_wise: true
18dtype: float16
