You can deploy this model and start earning money today!

tooltd/
GRM-3.2-Sky-MTP-GGUF

Name: GRM-3.2-Sky-MTP-GGUF
Availability: InStock

Views

No views yet

tooltd/GRM-3.2-Sky-MTP-GGUF

This model was converted to GGUF format from OrionLLM/GRM-3.2-Sky using llama.cpp via the ggml.ai's GGUF-my-repo space. Refer to the original model card for more details on the model.

Download Qwen3.6-35B-A3B MTP-ONLY from https://huggingface.co/a4lg/Qwen3.6-35B-A3B-MTP-ONLY-GGUF
Add MTP HEAD to GRM-3.2-Sky GGUF model by using my script modified. otherwise, it will cause an error. https://huggingface.co/tooltd/GRM-3.2-Sky-MTP-GGUF/blob/main/grm_mtp_graft.py

python grm_mtp_graft.py grm-3.2-sky-q8_0.gguf Qwen3.6-35B-A3B-MTP-ONLY-Q8_0.gguf grm-3.2-sky-mtp-q8_0.gguf

Draft acceptance rate is usually above 80%. Done!