Views
No views yet
mmproj-*) for image input and the
MTP head (mtp-*) for speculative decoding.| file | notes |
|---|---|
*-BF16.gguf | full precision |
*-Q8_0.gguf / *-Q6_K.gguf / *-Q5_K_M.gguf / *-Q4_K_M.gguf | weight quants (Q4_K_M = smallest) |
mmproj-*-{BF16,Q8_0}.gguf | vision projector (load with --mmproj for image input) |
mtp-*-{BF16,Q8_0,Q4_0}.gguf | MTP speculative-decoding head (optional) |
| openness ↑ | confab ↓ | factual ↑ | gsm8k ↑ | |
|---|---|---|---|---|
| stock base (censored) | 0.08 | 0.75 | 1.00 | 0.85 |
| Aggressive (α=1.15) | 0.88 | 0.725 | 1.00 | 0.85 |
| previous Aggressive (α≈1.24) | 0.80 | 0.80 | 1.00 | 0.817 |