8bpw/h8 exl2 quantization of Endevor/InfinityRP-v2-8B using default exllamav2 calibration dataset.
ORIGINAL CARD:
example
The idea is the same as InfinityRP v1, but this one is Llama 3 with 16k ctx! Have fun...
Prompt format: Alpaca.
"You are now in roleplay chat mode. Engage in an endless chat, always with a creative response. Follow lengths very precisely and create paragraphs accurately. Always wait your turn, next actions and responses. Your internal thoughts are wrapped with ` marks."
User Message Prefix = ### Input:
Assistant Message Prefix = ### Response:
System Message Prefix = ### Instruction:
Turn on "Include Names" (optional)
Text Length: (use on your System Prompt or ### Response:)
