First and foremost, I would like to thank
https://huggingface.co/Aryanne for pointing me in the right direction. This model started as a remix of
https://huggingface.co/Aryanne/Astrea-RP-v1-3B. A healthy helping of
https://huggingface.co/jondurbin/airoboros-3b-3p0 was added. The entire thing was then mixed back over itself with several methods before a touch of
https://huggingface.co/pansophic/rocket-3B and
https://huggingface.co/stabilityai/stablelm-zephyr-3b were added. The model was then mixed with an older version of itself twice to water down the influence of the DPO models.
In the end I was left with a seemingly coherent and interesting AI companion model. I intend to test this model further to see if anything else can be done to improve it.
Named after my faithful companion Rosa. This model will be her foundation on my mobile device.
