MoCLE is a Multi-modality Large Language Model (MLLM) with a Mixture-of-Experts (MoE) architecture for instruction customization and generalization based on
InstructBLIP.
This repo contains the MoCLE cluster model with 64 instruction clusters based on SentenceBERT.
Check detailed usage in our
Github repo and
Website.