This v2.1 release fixes the issues with v2.0 by using stock Gemma 4 instead of an exotic base model that made customizations to the final output layer of Gemma 4 that do not merge cleanly with other models. However, v2.1 still rarely produces some artifacts in a similar manner to v1, such as occasionally fusing two words together that should be separated by a space, or misspelling a word. These artifacts are quite rare in my testing and can be made even rarer by running more conservative sampler settings, like raising Min-P.
I believe the artifacting behavior comes from llmfan46/gemma-4-Ortenzya-The-Creative-Wordsmith-31B-it-uncensored-heretic in the recipe, which would explain it in v1 too. That ingredient helps shake up the word choices, but it also contributes to instability. The v2.1 recipe mitigates that impact better than v1 through strategic layer management, but I haven't perfected it yet. I think you'll find this model's outputs worth the trouble of having to occasionally fix a typo.
Gemma 4 thinking is not expected to work well with this model. The merge includes ingredients to maximize creativity, which tends to have a negative effect on thinking coherence. Thinking mode might work up to a point, but I do not recommend running thinking with this model, and in my opinion, this model does not benefit from it anyway.
You can use the master import JSON in this repo (Glistening-Gem-v2-ST-Import.json) to deploy the sampler settings below. I recommend using these values as a starting point for your own experiments. It's not like the model falls apart if you deviate from these settings, but they should be a reliable starting point for most creative tasks.
A note on DRY + Adaptive-P: Some people recommend not mixing these, but in practice I haven't noticed any issues. Feel free to drop DRY entirely if you want. Adaptive-P is already designed to avoid repetitions.
Sampler Settings
Try these settings as a starting point.
Temp
0.8
Min-P
0.1
Adaptive-P Target
0.6
Adaptive-P Decay
0.75
DRY Mult.
0.8
DRY Base
1.8
DRY Allowed Length
6
You can download the Glistening-Gem-v2-ST-Import.json file from this repo and import it directly into SillyTavern to get system prompt, chat template, and sampler settings all in one go.
This is a merge of pre-trained language models created using
mergekit.
Merge Method
This model was merged using the
DELLA merge method using
densenet/Gemma-4-31B-StyleTune-heretic-ara as a base.
See the model intro for more details and the mergekit_config.yaml file in the repo for the full recipe.