This model is trained on 3k examples of instructions dataset, high quality roleplay, for best result follow this format
<<HUMAN>>
How to do abc
<<AIBOT>>
Here is how
Or with system prompting for roleplay
<<SYSTEM>>
A's Persona:
B's Persona:
Scenario:
Add some instruction here on how you want your RP to go.
Bias, Risks, and Limitations
All bias of this model come from LLaMA2 with an exception of NSFW bias.....
Training Details
Training Data
3000 examples from LIMAERP, LIMA and I sample 1000 good instruction from Airboro
Training Procedure
Model is trained with 1 L4 from GCP costing a whooping 1.5USD
Training Hyperparameters
Training regime: [More Information Needed]
3 epochs with 0.0002 lr, full 4096 ctx token, LoRA
Speeds, Sizes, Times [optional]
It takes 8 hours to train this model with xformers enable
