You can deploy this model and start earning money today!

echarlaix/
SmolVLM2-256M-Video-Instruct-openvino-8bit-mixed

Name: SmolVLM2-256M-Video-Instruct-openvino-8bit-mixed
Availability: InStock

echarlaix/SmolVLM2-256M-Video-Instruct-openvino

finetune

apache-2.0

endpoints_compatible

Views

No views yet

This model is a quantized version of echarlaix/SmolVLM2-256M-Video-Instruct-openvino and is converted to the OpenVINO format. This model was obtained via the nncf-quantization space with optimum-intel.

First make sure you have optimum-intel installed:

pip install optimum[openvino]

To load your model you can do as follows:

python

from optimum.intel import OVModelForVisualCausalLM

model_id = "echarlaix/SmolVLM2-256M-Video-Instruct-openvino-8bit-mixed"
model = OVModelForVisualCausalLM.from_pretrained(model_id)