Views
No views yet
Update (2026-06-22): Read the base model card before using these. The original release was deliberately under-documented as part of a point about hype versus evidence in local AI. The full recipe and rationale are now on the base card.
llama.cpp / Ollama / LM Studio.Fill in the exact quant types you shipped.
| Quant | Approx size | Notes |
|---|---|---|
| Q4_K_M | TBD | |
| Q5_K_M | TBD | |
| Q6_K | TBD | |
| Q8_0 | TBD |