You can deploy this model and start earning money today!

dmgcsilva/
VIGiA-8B

Name: VIGiA-8B
Availability: InStock

safetensors

revistamodel

dmgcsilva/InstructionVidDial

meta-llama/Llama-3.1-8B-Instruct

finetune

Views

No views yet

VIGiA: Instructional Video Guidance via Dialogue Reasoning and Retrieval

VIGiA is a multimodal dialogue model for conversational instructional plan guidance, accepted at EACL 2026.

It assists users through complex multi-step procedures (e.g., cooking, DIY) via interactive dialogue, supporting plan-grounded answer generation, plan-aware VQA, visually-informed step generation, and conversational video moment retrieval.

Model Details

Language Model: LLaMA 3.1 8B Instruct
Visual Encoder: SigLIP SO400M (224x224, patch size 14)
Connector: 2-layer MLP
Training: 4-stage progressive training with LoRA

Citation

bibtex

@inproceedings{gloria-silva-etal-2026-vigia,
    title     = "{VIG}i{A}: Instructional Video Guidance via Dialogue Reasoning and Retrieval",
    author    = "Gl{\'o}ria-Silva, Diogo and Semedo, David and Magalh{\~a}es, Jo{\~a}o",
    booktitle = "Proceedings of the 2026 Conference of the European Chapter of the Association for Computational Linguistics",
    year      = "2026",
    publisher = "Association for Computational Linguistics",
}

dmgcsilva/VIGiA-8B

VIGiA: Instructional Video Guidance via Dialogue Reasoning and Retrieval

Model Details

Links

Citation

dmgcsilva/
VIGiA-8B