LLaMA-3-V: Extending the Visual Capabilities of LLaVA with Meta-Llama-3-8B-Instruct

Repository Overview

Training Strategy

• Only Vision-to-Language projector is trained. The rest of the model is frozen.
• Note: The repository contains only the projector weights.

Key Components

• Base Large Language Model (LLM): Meta-Llama-3-8B-Instruct
• Base Large Multimodal Model (LMM): LLaVA-v1.5

Training Data

• Pretraining Dataset: LCS-558K

Download It As

git lfs install
git clone https://huggingface.co/MBZUAI/LLaVA-Meta-Llama-3-8B-Instruct-pretrain

Contributions