This is the complete Qwen3.8-27B multimodal checkpoint produced with WarpQuant. It retains the vision tower and multimodal components while applying WarpQuant to the 64-layer text backbone.
The text backbone uses signed Hadamard rotation, 3-bit group quantization, block-GPTQ reconstruction, and Output-Fisher weak-column recovery. Token embeddings and the language-model head use group-128 INT4.
GSM8K uses the same first 500 examples, 5-shot prompts, and flexible-extract accuracy for all four models.
1from transformers import AutoModelForImageTextToText, AutoProcessor
2
3model_id = "HarimxChoi/WarpQuant-Qwen3.8-27B-R16E4H4"
4processor = AutoProcessor.from_pretrained(model_id)
5model = AutoModelForImageTextToText.from_pretrained(model_id, device_map="auto")
1@misc{choi2026warpquant,
2 author = {Harim Choi},
3 title = {WarpQuant: Dual-Domain LLM Quantization via Hadamard Rotation and Output-Fisher Sensitivity},
4 year = {2026},
5 url = {https://github.com/HarimxChoi/WarpQuant}
6}
