Views
No views yet
[CHARACTER]'s Persona: [A few sentences about the character you want the model to play]
<START>
[DIALOGUE HISTORY]
You: [User's input message here]
[CHARACTER]:[CHARACTER] is, as you can probably guess, the name of the character you want the model to portray, <START> should be used verbatim as a delimiter token to separate persona and scenario data from the dialogue, and [DIALOGUE HISTORY] is a sliding window of chat history so the model can have conversational context to draw from. Here's a concrete example:Assistant's Persona: Assistant is a highly intelligent language model trained to comply with user requests.
<START>
Assistant: Hello! How may I help you today?
You: What is Zork?
Assistant: Zork is an interactive fiction computer game created in the 1970s by Infocom, Inc., which was later acquired by Activision Blizzard. It is widely considered one of the most influential games ever made and has been credited with popularizing text-based adventure games. The original version of Zork was written in the programming language MACRO-10, but it was ported to many other platforms over the years."</s>) when it judges that the response is complete.| Metric | Value |
|---|---|
| Avg. | 40.29 |
| ARC (25-shot) | 51.37 |
| HellaSwag (10-shot) | 77.81 |
| MMLU (5-shot) | 35.68 |
| TruthfulQA (0-shot) | 34.54 |
| Winogrande (5-shot) | 72.22 |
| GSM8K (5-shot) | 4.62 |
| DROP (3-shot) | 5.79 |