Abstract
Sarcasm detection is a significant challenge in sentiment analysis,particularly due to its nature of conveying opinions where the intended meaningdeviates from the literal expression. This challenge is heightened in socialmedia contexts where code-mixing, especially in Dravidian languages, isprevalent. Code-mixing involves the blending of multiple languages within asingle utterance, often with non-native scripts, complicating the task forsystems trained on monolingual data. This shared task introduces a novel goldstandard corpus designed for sarcasm and sentiment detection within code-mixedtexts, specifically in Tamil-English and Malayalam-English languages. Theprimary objective of this task is to identify sarcasm and sentiment polaritywithin a code-mixed dataset of Tamil-English and Malayalam-English comments andposts collected from social media platforms. Each comment or post is annotatedat the message level for sentiment polarity, with particular attention to thechallenges posed by class imbalance, reflecting real-world scenarios.In thiswork, we experiment with state-of-the-art large language models like GPT-3.5Turbo via prompting to classify comments into sarcastic or non-sarcasticcategories. We obtained a macro-F1 score of 0.61 for Tamil language. Weobtained a macro-F1 score of 0.50 for Malayalam language.