This is a pretrained checkpoint, you can use it to instruct tune your multimodal models.

Check out the instructions here

Model type: LLaVA-JP is a vision-language model that can converse about input images.
This model is an LVLM model trained using google/siglip-so400m-patch14-384 as the image encoder and llm-jp/llm-jp-1.3b-v1.0 as the text decoder. supports the input of 768 x 768 high resolution images by scaling_on_scales method.

Apache-2.0