Views
No views yet
- Medical texts (on psychology, reproductive organs, anatomy, and pregnancy). These are formatted so the model, in character as a doctor or therapist, answers a patient's question in short to medium form.
- Excerpts from short stories and novellas (erotic and romantic) centered around both realistic and fantastic situations, covering several fetishes as well. These are sliced into ~2048 token chunks, and these long-form responses are all tied to the command “Enter narrator mode.” in the instructions.
- A selection from PIPPA, using a wide keyword search for tokens associated with low quality human or AI data to remove those responses, then a positive search was done for words and phrases associated with a higher reading level. These are converted to Alpaca with “Enter RP mode.” in all the instruction fields.
- ~18k tokens of GPT-4 generated data on role-playing from various characters’ perspectives, focusing on different situations and emotions. Includes many multi-turn conversations.| Training Loss | Epoch | Step | Validation Loss |
|---|---|---|---|
| 1.955 | 0.38 | 25 | 1.9037 |
| 1.6598 | 0.75 | 50 | 1.6192 |
| 1.5649 | 1.13 | 75 | 1.5010 |
| 1.4424 | 1.5 | 100 | 1.4424 |
| 1.4142 | 1.88 | 125 | 1.4068 |
| 1.4951 | 2.25 | 150 | 1.3908 |
| 1.4418 | 2.63 | 175 | 1.3864 |