Bonsai-8B — Unpacked FP16 Safetensors

We strongly recommend using the native 1-bit models instead. The 1-bit format is where all the benefits of Bonsai come from — up to 14x memory reduction, 6x faster inference, and 5x lower energy per token. This unpacked FP16 version is full-size and does not provide any of those advantages.

• Bonsai-8B GGUF Q1_0 — 1-bit GGUF for llama.cpp (CUDA, Metal, CPU)
• Bonsai-8B MLX 1-bit — 1-bit MLX for Apple Silicon