Qwen 2.5 32b RP Ink

Testimonials

whatever I tested was crack [...] It's got some refreshingly good prose, that's for sure

The NTR is fantastic with this tune, lots of good gooning to be had. [...] Description and scene setting prose flows smoothly in comparison to larger models.

This 32B handles complicated scenarios well, compared to a lot of 70Bs I've tried. Characters are portrayed accurately.

From the very limited testing I did, I quite like this. [...] I really like the way it writes. Granted, I'm completely shitfaced right now, but I'm pretty sure it's good.

[This model portrays] my character card almost exactly the way that I write them. It's a bit of a dream to get that with many of the current LLM.

Dataset

Quants

• Imatrix GGUFs (thanks, bart!)

Recommended Settings

• Temp 0.85 / Top P 0.8 / Top A 0.3 / Rep Pen 1.03
• Your samplers can go here! :3

Hyperparams

General

• Epochs = 1
• LR = 6e-5
• LR Scheduler = Cosine
• Optimizer = Paged AdamW 8bit
• Effective batch size = 16

LoRA

• Rank = 16
• Alpha = 32
• Dropout = 0.25 (Inspiration: Slush)

Credits