This model consists of a fine-tuned version of BgGPT-7B-Instruct-v0.2 for a propaganda detection task. It is effectively a binary classifier, determining wether propaganda is present in the output string. This model was created by Identrics, in the scope of the WASPer project. The detailed taxonomy of the full pipeline could be found here.

Designed as a binary classifier to determine whether a traditional or social media comment contains propaganda.

First install direct dependencies:

Then the model can be downloaded and used for inference:

The training dataset for the model consists of a balanced collection of Bulgarian examples, including both propaganda and non-propaganda content. These examples were sourced from a variety of traditional media and social media platforms and manually annotated by domain experts. Additionally, the dataset is enriched with AI-generated samples.

The model achieved an F1 score of 0.836 during evaluation.

This model was fine-tuned using a GPU / 2xNVIDIA Tesla V100 32GB.

If you find our work useful, please consider citing WASPer:

@article{2025wasper,
  title={WASPER: A BULGARIAN-LANGUAGE MODEL FOR DETECTING PROPAGANDA IN SOCIAL MEDIA CONTENT}, 
  author={Petrova, Y., Kiryakov, T., Kotseva, D. & Kostadinova, B.},
  journal={THE EUROPEAN UNION IN A DYNAMIC GLOBAL CONTEXT},
  year={2025}
}