ExllamaV2 version of the model created by
Undi!
Requires ExllamaV2, which is being developed by turboderp
https://github.com/turboderp/exllamav2 under an MIT license.
I could load 6bpw 24gb card without cfg cash with 4096 context.
8bpw required about 30gb to load at 4096 context.
This model is based on
Free Sydney V2, trying to get a... lewder assistant, you get it now.
This repo contain fp16 files of Lewd-Sydney-20B, an attempt to get our beloved Sydney open to R-18 content.
Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction:
{prompt}
### Response:
If you want to support me, you can
here.
