Oh hell yeah here we go. I've never quanted a 32b model before so hopefully these turn out alright. I ended up making a few more quant types than usual to see about different tiers. Probably won't happen again.
The advice in my 14b Kunou model quants probably still holds true here.
I do not really have anything planned for this model other than it being a generalist, and Roleplay Model? It was just something made and planned in minutes.
Same with the 14B and 72B version.
Kunou's the name of an OC I worked on for a couple of years, for a... fanfic. mmm...
A kind-of successor to L3-70B-Euryale-v2.2 in all but name? I'm keeping Stheno/Euryale lineage to Llama series for now.
I had a version made on top of Nemotron, a supposed Euryale 2.4 but that flopped hard, it was not my cup of tea.
This version is basically a better, more cleaned up Dataset used on Euryale and Stheno.
Recommended Model Settings | Look, I just use these, they work fine enough. I don't even know how DRY or other meme samplers work. Your system prompt matters more anyway.
Prompt Format: ChatML
Temperature: 1.1
min_p: 0.1
Future-ish plans:
- Complete this model series. - Further refine the Datasets used for quality, more secondary chats, more creative-related domains. (Inspired by Drummer)
- Work on my other incomplete projects. About half a dozen on the backburner for a while now.
Special thanks to my wallet for funding this, my juniors who share a single braincell between them, and my current national service.
Stay safe. There have been more emergency calls, more incidents this holiday season.
Also sorry for the inactivity. Life was in the way. It still is, just less so, for now. Burnout is a thing, huh?
