Beyond English: Evaluating Automated Measurement of Moral Foundations in Non-English Discourse with a Chinese Case Study

  • 2025-02-05 09:17:17
  • Calvin Yixiang Cheng, Scott A Hale
  • 0

Abstract

This study explores computational approaches for measuring moral foundations(MFs) in non-English corpora. Since most resources are developed primarily forEnglish, cross-linguistic applications of moral foundation theory remainlimited. Using Chinese as a case study, this paper evaluates the effectivenessof applying English resources to machine translated text, local languagelexicons, multilingual language models, and large language models (LLMs) inmeasuring MFs in non-English texts. The results indicate that machinetranslation and local lexicon approaches are insufficient for complex moralassessments, frequently resulting in a substantial loss of culturalinformation. In contrast, multilingual models and LLMs demonstrate reliablecross-language performance with transfer learning, with LLMs excelling in termsof data efficiency. Importantly, this study also underscores the need forhuman-in-the-loop validation of automated MF assessment, as the most advancedmodels may overlook cultural nuances in cross-language measurements. Thefindings highlight the potential of LLMs for cross-language MF measurements andother complex multilingual deductive coding tasks.

 

Quick Read (beta)

loading the full paper ...