Thanks to NousResearch and Meta for the base models.
A brief warning, no alignment or attempts of any kind were made to reign in, censor, or otherwise manipulate the outputs of this model. It is a raw model and may produce outputs that are unexpected or otherwise distateful. You are the master of your own destiny, and the master of this model, use with caution.
Quantization was 128 Group Size with act order on. This quantization was aimed at Exllama text generation.
Nous-Hermes is the base model, so the recommendation is to use their recommended alpaca instruct format for prompts:
Prompt Format
The model follows the Alpaca prompt format:
### Instruction:
<prompt>
### Response:
<leave a newline blank for model to respond>
or
### Instruction:
<prompt>
### Input:
<additional context>
### Response:
<leave a newline blank for model to respond>
