Overview of DIMEMEX at IberLEF 2024: Detection of Inappropriate Memes from Mexico

Resumen

In this paper, we present the overview of the DIMEMEX shared task which was organized at IberLEF 2024 and co-located in the framework of the 40th International Conference of the Spanish Society for Natural Language Processing (SEPLN 2024). The main aim of this task is to promote the research on developing automatic solutions for detecting inappropriate content in memes. Two subtasks were considered: (i) A three-way classification task aimed to determine if a meme contains hate speech, inappropriate content, or neither; and (ii) A fine-grained classification task in which a meme may be categorized into specific hate speech categories. A multimodal manual annotated corpus comprising both images and text associated with each meme was provided to the participants. A total of 5 systems were submitted for the final evaluation phase. Competitive results were reported for both subtasks being Subtask 1 the one with higher results. The data and results are available at the shared task website at https://codalab.lisn.upsaclay.fr/competitions/18118.