You can deploy this model and start earning money today!

Trofish/
RoViQA-vit-roberta-image-captioning

Name: RoViQA-vit-roberta-image-captioning
Availability: InStock

Views

No views yet

RoViQA: Visual-Question-Answering model created by combining Roberta and ViT

This repository contains the code for RoViQA, a Visual Question Answering (VQA) model that combines image features extracted using Vision Transformer (ViT) and text features extracted using RoBERTa. The project includes training, inference, and various utility scripts.
github: https://github.com/Tro-fish/RoViQA-Visual_Question_Answering

Model Architecture

RoViQA Overview

RoViQA is a Visual Question Answering (VQA) model that leverages the power of Vision Transformer (ViT) and RoBERTa to understand and answer questions about images. By combining the strengths of these two models, RoViQA can effectively process and interpret both visual and textual information to provide accurate answers.

Model parameter

Base Models
- Roberta-base: 110M parameters
- ViT-base: 86M parameters
RoViQA: 215M parameters

Trofish/RoViQA-vit-roberta-image-captioning

Model Architecture

RoViQA Overview

Model parameter

Trofish/
RoViQA-vit-roberta-image-captioning