You can deploy this model and start earning money today!

rodrigomt/
Qwen3-Coder-30B-A3B-Instruct-480b-Distill-V2-GGUF

Name: Qwen3-Coder-30B-A3B-Instruct-480b-Distill-V2-GGUF
Availability: InStock

Views

No views yet

🧠 Qwen3-Coder-30B-A3B-Instruct-480B-Distill-V2 GGUFs

Format	Description
F16	Full precision (16-bit), better quality, larger size ⚖️
Q3_K_XL	Quantized (3-bit XL variant, based on the quantization table of the unsloth model Qwen3-30B-A3B-Thinking-2507), smaller size, faster inference ⚡
Q4_K_XL	Quantized (4-bit XL variant, based on the quantization table of the unsloth model Qwen3-30B-A3B-Thinking-2507), smaller size, faster inference ⚡
Q5_K_XL	Quantized (5-bit XL variant, based on the quantization table of the unsloth model Qwen3-30B-A3B-Thinking-2507), medium size, faster inference ⚡

Example with llama.cpp:

./main -m ./gguf-file-name.gguf -p "Hello world!"