Chat
Models
Datasets
Deploy
Pricing
Docs

Chat
Models
Datasets
Deploy

Chat
Models
Datasets
Deploy
Pricing
Docs

© 2026 AlphaNeural AIPrivacy Terms Cookies

Proud member of

Qwen3-VL-8B-Instruct-quantized.w4a16 – AI Model by SherlockID365 | AlphaNeural AI

You can deploy this model and start earning money today!

SherlockID365/
Qwen3-VL-8B-Instruct-quantized.w4a16

like

0

image-text-to-text

vision-language

Qwen/Qwen3-VL-8B-Instruct

endpoints_compatible

compressed-tensors

Views

No views yet

code taken from : https://github.com/vllm-project/llm-compressor/blob/main/examples/awq/qwen3-vl-30b-a3b-Instruct-example.py

Qwen3-VL-8B-Instruct-AWQ

AWQ (W4A16) quantized version of Qwen/Qwen3-VL-8B-Instruct.

Quantization: AWQ, 4 bits, group_size=128, zero_point=true, version="gemm"
modules_to_not_convert: ["visual"]
Prepared with LLM Compressor oneshot AWQ. recipe = AWQModifier( targets="Linear", scheme="W4A16", ignore=[r"re:model.visual.", r"re:visual."], # drop lm_head from ignore duo_scaling=True, )