Views
No views yet
zamba2-1.2b-instruct-v2-q8_0.gguf (Q8_0/BF16 source, not a 4-bit GGUF, to avoid compounding quantization error through a second 4-bit pass). Structurally verified against the source GGUF (exact tensor/element count match) and numerically verified (dequantized values within expected 4-bit quantization tolerance of the reference).1git clone https://github.com/bong-water-water-bong/1bit-systems
2cd 1bit-systems
3cmake -B build/engine/npu -S engine/npu -DCMAKE_BUILD_TYPE=Release # ONEBP_SUPPORT is on by default
4cmake --build build/engine/npu --target npu_engine_universal -j8
5./build/engine/npu/npu_engine_universal /path/to/Zamba2-1.2B-Instruct-v2.1bp --model-tag zamba2-1.2b-instruct-v2