This is the first merge I have ever tried. It seems to be working, or by the minimum does not appear to be broken :) The prime idea of this is to be an experiment and help me learn how to do merges and quants.
This model is intended for role-playing and storywriting purposes.
This is a merge of pre-trained language models created using
mergekit.
This model was merged using the passthrough merge method.
1slices:
2 - sources:
3 - model: Nitral-AI/Infinitely-Laydiculous-9B
4 layer_range: [0, 20]
5 - sources:
6 - model: SanjiWatsuki/Kunoichi-DPO-v2-7B
7 layer_range: [12, 32]
8merge_method: passthrough
9dtype: float16