You can deploy this model and start earning money today!

ewchampion/
Ternary-Bonsai-8B-TQ2_0-GGUF

Name: Ternary-Bonsai-8B-TQ2_0-GGUF
Availability: InStock

gguf

prism-ml/Ternary-Bonsai-8B-gguf

Views

No views yet

Ternary-Bonsai-8B-TQ2_0-GGUF

Requantized from prism-ml/Ternary-Bonsai-8B-gguf's F16 baseline to GGML's native TQ2_0 ternary type (~2.06 bits/weight), using stock llama.cpp (tag b9498) — not PrismML's custom fork/packing.

Sanity-checked via llama-server's OpenAI-compatible endpoint on CPU (Metal has no TQ1_0/TQ2_0 matmul kernels at this llama.cpp version — this model must run with -ngl 0 / CPU-only until upstream adds Metal support):

Chat coherence: pass ("What is the capital of France?" -> "The capital of France is Paris.")
Native tool-calling (Qwen3 <tool_call> format): pass, clean structured tool_calls output.

License: Apache 2.0 (carried over from base model).

ewchampion/Ternary-Bonsai-8B-TQ2_0-GGUF

Ternary-Bonsai-8B-TQ2_0-GGUF

ewchampion/
Ternary-Bonsai-8B-TQ2_0-GGUF