You can deploy this model and start earning money today!

ilia-dybal/
Qwen-2.5-VL-3b-Instruct-4WA16-GPTQ-Culinary

Name: Qwen-2.5-VL-3b-Instruct-4WA16-GPTQ-Culinary
Availability: InStock

Views

No views yet

Model Card for Model ID

The repository contains a finetuned version of Qwen-2.5-VL-3B-Instruct model. The model was finetuned on custom vision dataset specialized for culinary tasks: structured receipe and engredients extraction.

The model was initially finetuned in a A100 GPU with 4-bit QLoRA and post-quantized with llm-compressor using W6A16 scheme and GPTQ algorithm. The vision encoder retained untouched to preserce dynamic resolution capabilities.

Model Details

Model Description

Developed by: Ilia Dybal
Funded by: Ilia Dybal
Shared by: Ilia Dybal
Model type: Multimodal Large Visual Language Model (LVLM)
Language(s) (NLP): Russian
License: Apache 2.0
Finetuned from model: Qwen/Qwen2.5-VL-3B-Instruct

Model Sources [optional]

Repository: Qwen/Qwen2.5-VL-3B-Instruct
Paper: https://arxiv.org/pdf/2502.13923

Uses

Direct Use

Structured receipe and ingredients extraction from an image.

Out-of-Scope Use

Medical or clinical dietary diagnostics.
General non-culinary visual analysis (for general VLM tasks, use the base Qwen2.5-VL-3B-Instruct).

Bias, Risks, and Limitations

[More Information Needed]

Recommendations

Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.

How to Get Started with the Model

Use the code below to get started with the model.

Option 1: Fast Serving via vLLM (Recommended for Production)

Launch the vLLM server from your terminal:

bash

vllm serve ilia-dybal/Qwen-2.5-VL-3b-Instruct-4bit-LoRA-culinary \
    --trust-remote-code \
    --max-model-len 4096 \
    --limit-mm-per-prompt '{"image": 1}'

Query the server using the OpenAI Python Client:

python

import base64
from openai import OpenAI

client = OpenAI(base_url="http://localhost:8000/v1", api_key="EMPTY")

def encode_image(image_path):
    with open(image_path, "rb") as f:
        return f"data:image/jpeg;base64,{base64.b64encode(f.read()).decode('utf-8')}"

response = client.chat.completions.create(
    model="ilia-dybal/Qwen-2.5-VL-3b-Instruct-4bit-LoRA-culinary",
    messages=[
        {
            "role": "user",
            "content": [
                {"type": "text", "text": "Analyze this dish and provide the recipe."},
                {"type": "image_url", "image_url": {"url": encode_image("dish.jpg")}}
            ]
        }
    ],
    max_tokens=512
)

print(response.choices[0].message.content)

Option 2: Native Hugging Face Transformers