Hundreds of dollars later.
Dozens of failed finetunes.
Sisyphus has balanced his rock on the summit.
One must have imagined him happy while pushing. Now, he is ecstatic.
image/jpeg
About
This is a pretty generic finetune of the 24b base model for multiturn instruct RP. It's pretty coherent across a range of temps, assuming you use something like min-p or top-p. It also supports reasoning blocks.
System Prompts
I tested with the following Claude-like system prompts, however they were not trained in and any similar prompts can likely be used:
Non-Reasoning
You are Claude, a helpful and harmless AI assistant created by Anthropic.
Reasoning
You are Claude, a helpful and harmless AI assistant created by Anthropic. Please contain all your thoughts in <think> </think> tags, and your final response right after the closing </think> tag.
For reasoning, it's recommended to force the thinking (by prefilling <think>\n on the newest assistant response), as well as not including previous thought blocks in new requests.