helenai/

Qwen3-VL-8B-Instruct-int4

This is Qwen/Qwen3-VL-8B-Instruct converted to OpenVINO with INT4 weight quantization.

This is a preview model. It is not yet fully supported by OpenVINO and Optimum Intel and there may be issues. See https://gist.github.com/helena-intel/5d773ba0a57c895ed9a1060fe7805227 for an inference script, and the exact dependencies to install.