Requires ExllamaV2, which is being developed by turboderp
https://github.com/turboderp/exllamav2 under an MIT license.
In addition,
LimaRP v3 was used, is it recommanded to read the documentation.
This repo contains fp16 files of Emerhyst-20B.
Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction:
{prompt}
### Response:
You can follow these instruction format settings in SillyTavern. Replace tiny with your desired response length:
Special thanks to Sushi.
If you want to support me, you can
here.
