MoCLE is a Multi-modality Large Language Model (MLLM) with a Mixture-of-Experts (MoE) architecture for instruction customization and generalization based on
InstructBLIP.
This repo contains the MoCLE checkpoint with 64 instruction clusters and a routing temperature of 0.05.
Check detailed usage in our
Github repo and
Website.