This is a merge of pre-trained language models created using
mergekit.
This model has no official affiliation with Weather and his SillyTavern Extensions. This is simply a fan project to help fellow users of these extensions.
CREC-n-WREC-Mate is a model made to help create World Info entries mid-roleplay using the SillyTavern extensions
CREC and
WREC.
The responses a bit on the shorter side by default, but this should be all the more beneficial for creating World Info entries. Needless to say, this isn't a model designed for creating Char Cards, instead it's meant for saving characters you encounter on your adventures to a Lorebook, so make sure to enable the feature that allows adding characters to a WI entry in the CREC settings menu.
This model was merged using the
Conflict-Aware N:M Sparsification merge method using
TheDrummer/Cydonia-24B-v2 as a base.
1models:
2 - model: TheDrummer/Cydonia-24B-v2
3 - model: AlexBefest/CardProjector-24B-v3
4 parameters:
5 weight: 0.4
6 n_val: 16
7 m_val: 32
8 - model: CharGen/CharGen-v3-beta-rl-55-s48
9 parameters:
10 weight: 0.2
11 n_val: 12
12 m_val: 32
13merge_method: cabs
14default_n_val: 8
15default_m_val: 32
16pruning_order:
17 - AlexBefest/CardProjector-24B-v3
18 - CharGen/CharGen-v3-beta-rl-55-s48
19base_model: TheDrummer/Cydonia-24B-v2
20dtype: bfloat16