This is like Gembo v1, but with 6-7% more human data. Does perform a bit worse on the benches(who cares? I do.), but should be able to write in more diverse styles(See waxwing-styles.txt, tested it with v1, v1 does it better.). Mainly made for RP, but should be okay as an assistant. Turned out quite good, considering the amount of LORAs I merged into it.
Observations
GPTisms and repetition: put temperature and rep. pen. higher, make GPTisms stop sequences
A bit different than the ususal stuff; I'd say that it has so much slop in it that it unslops itself
Lightly censored
Fairly neutral, can be violent if you ask it really good, Goliath is a bit better at it
Has a bit of optimism baked in, but it's not very severe, maybe a tiny bit more than in v1?
Don't put too many style tags, here less is better
Unlike v1, 1.1 knows a bit better when to stop
Needs more wrangling than v1, but once you get it going it's good
Sometimes can't handle '
Moderately intelligent
Quite creative
Worth over v1?
Nah. I prefer hyperslop over this "humanized" one. Maybe I've been poisoned by slop.
Naming
Internal name of this model was euryale-guano-saiga-med-janboros-kim-wing-lima-wiz-tony-d30-s40, but I decided to keep it short, and since it was iteration G in my files, I called it "Gembo".
Prompt format
Alpaca. You can also try some other formats, I'm pretty sure it has a lot of them from all those merges.
### Instruction:
{instruction}
### Response:
Settings
As I already mentioned, high temperature and rep.pen. works great.
For RP try something like this:
temperature=5
MinP=0.10
rep.pen.=1.15
Adjust to match your needs.
How it was created
I took Sao10K/Euryale-1.3-L2-70B (Good base model) and added
Then I SLERP-merged it with cognitivecomputations/dolphin-2.2-70b (Needed to bridge the gap between this wonderful mess and Smaxxxer, otherwise it's quality is low) with 0.3t and then SLERP-merged it again with ChuckMcSneed/SMaxxxer-v1-70b (Creativity) with 0.4t. For SLERP-merges I used https://github.com/arcee-ai/mergekit.
