May 1st 2024: GGUF have been fixed with
this PR of llama.cppThis repo contains GGUF files of LewdPlay Llama3, a finetuned model on multiple RP datasets based on
meta-llama/Meta-Llama-3-8B-Instruct.
<|begin_of_text|><|start_header_id|>system<|end_header_id|>
{system_prompt}<|eot_id|><|start_header_id|>user<|end_header_id|>
{input}<|eot_id|><|start_header_id|>assistant<|end_header_id|>
{output}<|eot_id|>
SillyTavern files of Llama3 prompt format (if you still don't have them) :
Context -
InstructWork best with character card well written, with some exemple message, memory, etc...
If you want to support me, you can
here.
