Views
No views yet
config.json, no separate tokenizer file for the tensors themselves.| Kind | Count | Storage |
|---|---|---|
| Norms / biases (1D) | 762 | Raw float32 — small, precision-sensitive, not quantized |
| Weight matrices (2D) | 401 | Q4NX-tiled, 4-bit |
| MoE expert stacks (3D, 16 experts each) | 120 | Each expert's slice independently Q4NX-tiled |
ZAYA1-8B-Q4_K_M.gguf, 5.57 GB) — file is 6.58 GB.feat/onebp-moe-experts history in the 1bit-systems repo for the format/converter/loader fix.1git clone https://github.com/bong-water-water-bong/1bit-systems
2cd 1bit-systems
3cmake -B build/engine/npu -S engine/npu -DCMAKE_BUILD_TYPE=Release # ONEBP_SUPPORT is on by default
4cmake --build build/engine/npu --target npu_engine_universal -j8
5./build/engine/npu/npu_engine_universal /path/to/ZAYA1-8B.1bp --model-tag zaya1_8b