The system is the first collection of models and pipelines for membership inference attacks against multimodal large language models, built initially with a priority for the Russian language, and extendable to any other language or dataset.
Pipeline supports different modalities:
Video, Audio and Image. In our experiments, we focus on
MERA datasets, however, the model can be used to other languages.
Training and inference code can be obtained
here.