🐉 Orochi 24B v0

• TheDrummer/Cydonia-24B-v2
• TroyDoesAI/BlackSheep-24B
• dphn/Dolphin-Mistral-24B-Venice-Edition
• huihui-ai/Mistral-Small-24B-Instruct-2501-abliterated

• Orochi-24B-v0-cp0-Q6_K.gguf | dare_ties
• Orochi-24B-v0-cp1-Q6_K.gguf | karcher
• Orochi-24B-v0-cp2-Q6_K.gguf | della_linear
• Orochi-24B-v0-cp3-Q6_K.gguf | breadcrumbs
• Orochi-24B-v0-cp4-Q6_K.gguf | sce
• Orochi-24B-v0-cp5-Q6_K.gguf | model_stock
• Orochi-24B-v0-cp6-Q6_K.gguf | dare_ties
• Orochi-24B-v0-cp7-Q6_K.gguf | nuslerp

• This is a balanced DARE_TIES of the 4 models. It is meant to be used as a baseline comparison to the other merges, especially checkpoint 6.

• The 4 models are merged via the following 5 methods:

1. karcher
2. della_linear
3. breadcrumbs
4. sce (top_k 1.0)
5. model_stock

• A DARE_TIES merge of Stage 1 merges. The theory is to test to see if a DARE_TIES merge of the Stage 1 merges had any noticeable improvements or degradations compared to Stage 0.

• NUSLERP merge of cp_0 with cp_6. The theory is to test if there is improvement or degradation.

• Failed Merge (checkpoint 8): SCE with top_k set to 0.25 resulted in unmergeable safetensors, and while it quanted, the GGUF was unusable too. This was originally meant to be checkpoint 4 but was swapped out after merge-kit failed on Stage 2.
• Failed Merge (checkpoint 9): A stage 3 attempt to use arcee_fusion instead of nuslerp, which resulted in a safetensors twice as large.

• dare_linear -> della = Applies precision to randomness (Incorrect Pipeline). You are asking a surgical tool (della) to operate on a model where parameter magnitudes are the result of a random process (dare_linear). The tool's fundamental assumption—that magnitude equals importance—is broken, making the pipeline conceptually flawed.
• della_linear -> dare_ties = Applies randomness to precision (Correct Pipeline). You are first creating a high-quality, precise "expert" model where magnitudes do correlate with importance (della_linear). Then, you use a robust, unbiased method (dare_ties) to randomly sample from this expert and others, safely integrating them while resolving conflicts. This pipeline is logical and synergistic.

config.yaml