The primary use of Vim is research on vision tasks, e.g., classification, segmentation, detection, and instance segmentation, with an SSM-based backbone.
The primary intended users of the model are researchers and hobbyists in computer vision, machine learning, and artificial intelligence.
Then you can load this checkpoint and start training.
Training Details
Vim is pretrained on ImageNet-1K with classification supervision.
The training data is around 1.3M images from ImageNet-1K dataset.
See more details in this paper.
Evaluation
Vim-base is evaluated on ImageNet-1K val set, and achieves 81.9% Top-1 Acc. See more details in this paper.
Additional Information
Citation Information
@article{vim,
title={Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model},
author={Lianghui Zhu and Bencheng Liao and Qian Zhang and Xinlong Wang and Wenyu Liu and Xinggang Wang},
journal={arXiv preprint arXiv:2401.09417},
year={2024}
}