BRIGHTER: BRIdging the Gap in Human-Annotated Textual Emotion Recognition Datasets for 28 Languages

  • 2025-05-28 16:24:43
  • Shamsuddeen Hassan Muhammad, Nedjma Ousidhoum, Idris Abdulmumin, Jan Philip Wahle, Terry Ruas, Meriem Beloucif, Christine de Kock, Nirmal Surange, Daniela Teodorescu, Ibrahim Said Ahmad, David Ifeoluwa Adelani, Alham Fikri Aji, Felermino D. M. A. Ali, Ilseyar Alimova, Vladimir Araujo, Nikolay Babakov, Naomi Baes, Ana-Maria Bucur, Andiswa Bukula, Guanqun Cao, Rodrigo Tufino Cardenas, Rendi Chevi, Chiamaka Ijeoma Chukwuneke, Alexandra Ciobotaru, Daryna Dementieva, Murja Sani Gadanya, Robert Geislinger, Bela Gipp, Oumaima Hourrane, Oana Ignat, Falalu Ibrahim Lawan, Rooweither Mabuya, Rahmad Mahendra, Vukosi Marivate, Alexander Panchenko, Andrew Piper, Charles Henrique Porto Ferreira, Vitaly Protasov, Samuel Rutunda, Manish Shrivastava, Aura Cristina Udrea, Lilian Diana Awuor Wanzare, Sophie W
  • 0

Abstract

People worldwide use language in subtle and complex ways to express emotions.Although emotion recognition--an umbrella term for several NLP tasks--impactsvarious applications within NLP and beyond, most work in this area has focusedon high-resource languages. This has led to significant disparities in researchefforts and proposed solutions, particularly for under-resourced languages,which often lack high-quality annotated datasets. In this paper, we presentBRIGHTER--a collection of multilabeled, emotion-annotated datasets in 28different languages and across several domains. BRIGHTER primarily coverslow-resource languages from Africa, Asia, Eastern Europe, and Latin America,with instances labeled by fluent speakers. We highlight the challenges relatedto the data collection and annotation processes, and then report experimentalresults for monolingual and crosslingual multi-label emotion identification, aswell as emotion intensity recognition. We analyse the variability inperformance across languages and text domains, both with and without the use ofLLMs, and show that the BRIGHTER datasets represent a meaningful step towardsaddressing the gap in text-based emotion recognition.

 

Quick Read (beta)

loading the full paper ...