Vision-and-Language Transformer (ViLT) model pre-trained on GCC+SBU+COCO+VG (200k steps). It was introduced in the paper
ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision by Kim et al. and first released in
this repository.
Disclaimer: The team releasing ViLT did not write a model card for this model so this model card has been written by the Hugging Face team.
You can use the raw model for visual question answering.
1@misc{kim2021vilt,
2 title={ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision},
3 author={Wonjae Kim and Bokyung Son and Ildoo Kim},
4 year={2021},
5 eprint={2102.03334},
6 archivePrefix={arXiv},
7 primaryClass={stat.ML}
8}