Abstract
Leveraging Large Multimodal Models (LMMs) to simulate human behaviors whenprocessing multimodal information, especially in the context of social media,has garnered immense interest due to its broad potential and far-reachingimplications. Emojis, as one of the most unique aspects of digitalcommunication, are pivotal in enriching and often clarifying the emotional andtonal dimensions. Yet, there is a notable gap in understanding how theseadvanced models, such as GPT-4V, interpret and employ emojis in the nuancedcontext of online interaction. This study intends to bridge this gap byexamining the behavior of GPT-4V in replicating human-like use of emojis. Thefindings reveal a discernible discrepancy between human and GPT-4V behaviors,likely due to the subjective nature of human interpretation and the limitationsof GPT-4V's English-centric training, suggesting cultural biases and inadequaterepresentation of non-English cultures.