This is a simple 50/50 merge of two of my favorite Yi 34B-based models for roleplay and creative writing, created using mergekit on Arcee.ai.
There's a good amount of Nous Capybara 34B in here, some Bagel DPO, Lima RP v3, and other goodness. Less sloppy thanks to Kyllene. 200k context. Uncensored.
Use with the metadata prompt format, Alpaca-LimaRP, or Vicuna.
Recommended settings: 0.8-1 temp, 1.1-1.2 rep pen, 1 top P, 0.05 min P, 40 top K.
Add </s> to stop strings, and /n {{user}} or [INST] if necessary.
I use a slightly modified version of RisuAI's default system prompt with good results. I suggest adding a couple lines to the system prompt telling the model to write in complete sentences, and NOT to write prompts to itself.
It's sensitive to small changes in settings and to the style/format of your own writing.
The original upload had a broken tokenizer. If you downloaded before 10/2/24, please re-download.
The following YAML configuration was used to produce this model:
yaml
1base_model: TeeZee/Kyllene-34B-v1.1
2chat_template: auto
3dtype: float16
4merge_method: ties
5models:6-model: TeeZee/Kyllene-34B-v1.1
7parameters:8density:0.59weight:0.510-model: Doctor-Shotgun/Nous-Capybara-limarpv3-34B
11parameters:12density:0.513weight:0.514parameters:15embed_slerp:true16int8_mask:true17normalize:false18tokenizer_source: base
19