Quantization made by Richard Erkhov.
A creative writing model, using the superb
senseable/WestLake-7B-v2 as a base, finetuned on GPT-4 outputs to a diverse variety of prompts. It in no way competes with GPT-4 - it's quality of writing is below it, and it is primarily meant to be run in offline, local environments.
On creative writing benchmarks, it is consistently ranked higher than most other models -
it scores 72.37, beating goliath-120b, yi chat, and mistral-large.
It is designed for
single-shot interactions. You ask it to write a story, and it does. It is NOT designed for chat purposes, roleplay, or follow-up questions.
Trained w/ a 40M parameter lora on
N8Programs/CreativeGPT for 3 epochs. Overfit slightly (for much better benchmark results).
Bot trained on NSFW (sexual or violent) content but will generate it when asked - it has not been trained with refusals. If you wish to ADD refusal behavior in, further tuning or filtering will be neccessary.
GGUFs available at
Coxcomb-GGUF
Should work with transformers (not officially tested).
Tends to generate stories with happy, trite endings. Most LLMs do this. It's very hard to get them not to.
Trained on a single M3 Max in roughly 12 hours.
