Findings of the WASSA 2024 EXALT shared task on explainability for cross-lingual emotion in tweets

Publication type
C1
Publication status
Published
Authors
Maladry, A, Singh, P., & Lefever, E.
Editor
Orphée De Clercq, Jeremy Barnes, Valentin Barriere, Shabnam Tafreshi, Joao Sedoc and Roman Klinger
Series
Proceedings of the 14th Workshop on Computational Approaches to Subjectivity, Sentiment, & Social Media Analysis
Pagination
454-463
Publisher
Association for Computational Linguistics (ACL)
Conference
14th Workshop on Computational Approaches to Subjectivity, Sentiment, & Social Media Analysis (WASSA 2024) (Bangkok, Thailand)
Download
(.pdf)
View in Biblio
(externe link)

Abstract

This paper presents a detailed description and results of the first shared task on explainability for cross-lingual emotion in tweets. Given a tweet in one of the five target languages (Dutch, Russian, Spanish, English, and French), systems should predict the correct emotion label (Task 1), as well as the words triggering the predicted emotion label (Task 2). The tweets were collected based on a list of stop words to prevent topical or emotional bias and were subsequently manually annotated. For both tasks, only a training corpus for English was provided, obliging participating systems to design cross-lingual approaches. Our shared task received submissions from 14 teams for the emotion detection task and from 6 teams for the trigger word detection task. The highest macro F1-scores obtained for both tasks are respectively 0.629 and 0.616, demonstrating that cross-lingual emotion detection is still a challenging task.