Llama 3 is a strong base model with strong world understanding and creativity. Additional instruct finetuning trades that world understanding and creativity for instruction following that Llama doesn't require in order to adhere to most forms of roleplay.
This model was trained on unstructured text only, no instruct related fine-tuning was performed.
For a more user-friendly version of this model's approach, visit
tryspellbound.com if you're simply looking to roleplay.
The main goal is to explore how presenting LLMs with history and instructions separately affects their performance, demonstrating:
For advanced prompting, see
this document