VCoder-DS LLaVA-1.5-7b was trained on COST training dataset in December 2023. It uses the pretrained
LLaVA-1.5-7b model weights. It was introduced by Jain et al. in
this repository.
VCoder is an adapter for improving existing Multimodal LLMs at object-level perception tasks with the use of perception modalities as control inputs while retaining performance on other tasks.
1@article{jain2023vcoder,
2 title={{VCoder: Versatile Vision Encoders for Multimodal Large Language Models}},
3 author={Jitesh Jain and Jianwei Yang and Humphrey Shi},
4 journal={arXiv},
5 year={2023}
6}
