LoTLIP ViT-B/16 model pre-trained on 100M scale dataset.
Zero-shot long text-image retrieval, short text-image retrieval, and image classification, among others.
Use the
code to get started with the model.
The models are trained with 100M scale dataset which contains long text-image pairs.
The testing is performed with
DCI,
IIW and
ShareGPT4V for long text-image retrieval and ImageNet1k for classification.
1@inproceedings{LoTLIP,
2 title={LoTLIP: Improving Language-Image Pre-training for Long Text Understanding},
3 author={Wu, Wei and Zheng, Kecheng and Ma, Shuailei and Lu, Fan and Guo, Yuxin and Zhang, Yifei and Chen, Wei and Guo, Qingpei and Shen, Yujun and Zheng-Jun, Zha},
4 booktitle={arXiv},
5 year={2024}
6}
