Do Generative AI Models Output Harm while Representing Non-Western Cultures: Evidence from A Community-Centered Approach

  • 2024-07-24 18:25:26
  • Sourojit Ghosh, Pranav Narayanan Venkit, Sanjana Gautam, Shomir Wilson, Aylin Caliskan
  • 0

Abstract

Our research investigates the impact of Generative Artificial Intelligence(GAI) models, specifically text-to-image generators (T2Is), on therepresentation of non-Western cultures, with a focus on Indian contexts.Despite the transformative potential of T2Is in content creation, concerns havearisen regarding biases that may lead to misrepresentations andmarginalizations. Through a community-centered approach and grounded theoryanalysis of 5 focus groups from diverse Indian subcultures, we explore how T2Ioutputs to English prompts depict Indian culture and its subcultures,uncovering novel representational harms such as exoticism and culturalmisappropriation. These findings highlight the urgent need for inclusive andculturally sensitive T2I systems. We propose design guidelines informed by asociotechnical perspective, aiming to address these issues and contribute tothe development of more equitable and representative GAI technologies globally.Our work also underscores the necessity of adopting a community-centeredapproach to comprehend the sociotechnical dynamics of these models,complementing existing work in this space while identifying and addressing thepotential negative repercussions and harms that may arise when these models aredeployed on a global scale.

 

Quick Read (beta)

loading the full paper ...