Quantized using 200 samples of 8192 tokens from an RP-oriented
PIPPA dataset.
Requires ExllamaV2 version 0.0.11 and up.
Original model README below.
I find its output as an assistant to be less dry and it is stable and imaginative in brief roleplay testing. Tested with simple sampling, requires rerolls but when it's good it's good. I can't say how well it will be when the context fills up but I was pleasantly surprised.
It definitely has one of the most varied lexicons out of any Mixtral Instruct based model I've tested so far with excellent attention to detail with respect to context.
