ColSmolVLM is a model based on a novel model architecture and training strategy based on Vision Language Models (VLMs) to efficiently index documents from their visual features. It is a SmolVLM extension that generates ColBERT- style multi-vector representations of text and images. It was introduced in the paper ColPali: Efficient Document Retrieval with Vision Language Models and first released in this repository

This version is the untrained base version to guarantee deterministic projection layer initialization.

ColSmol's vision language backbone model (ColSmolVLM) is under apache2.0 license. The adapters attached to the model are under MIT license.

If you use any datasets or models from this organization in your research, please cite the original dataset as follows: