8bpw/h8 exl2 quantization of Endevor/InfinityRP-v1-7B using default exllamav2 calibration dataset.
ORIGINAL CARD:
example
This is an experimental model I currently use. It's far from great as I'm still working on it, but I leave it here for people to try if interested in this format.
This model was basically made to stop some upsetting hallucinations, so {{char}} mostly and occasionally will wait {{user}} response instead of responding itself or deciding for {{user}}, also, my primary idea was to create a cozy model that thinks.*