Views
No views yet
| Mixed-Precision Recipe | Bit-Width | This Repo | GGUF Type |
|---|---|---|---|
| 100% 4-bit + 0% 1.58-bit | 4 | ✔️ | Q4_0 |
| 50% 4-bit + 50% 1.58-bit | 2.79 | ✖️ | Not supported |
| 12.5% 4-bit + 87.5% 1.58-bit | 1.88 | ✖️ | Not supported |
| 0% 4-bit + 100% 1.58-bit | 1.58 | ✔️ | TQ1_0, TQ2_0 |
Qwen3-0.6B-BF16.gguf: BF16 model from the original Qwen3-0.6BQwen3-0.6B-EdgeRazor-Q4_0.gguf: Q4_0 model from the Qwen3-0.6B-EdgeRazor-4bitQwen3-0.6B-EdgeRazor-TQ1_0.gguf: TQ1_0 model from Qwen3-0.6B-EdgeRazor-1.58bitQwen3-0.6B-EdgeRazor-TQ2_0.gguf: TQ2_0 model from Qwen3-0.6B-EdgeRazor-1.58bit@article{zhangsh-edgerazor,
title={{EdgeRazor}: A Lightweight Framework for Large Language Models via Mixed-Precision Quantization-Aware Distillation},
author={Shu-Hao Zhang and Le-Tong Huang and Xiang-Sheng Deng and Xin-Yi Zou and Chen Wu and Nan Li and Shao-Qun Zhang},
year={2026},
journal={arXiv preprint arXiv:2605.04062}
}