Abstract
As leading examples of large language models, ChatGPT and Gemini claim toprovide accurate and unbiased information, emphasizing their commitment topolitical neutrality and avoidance of personal bias. This research investigatesthe political tendency of large language models and the existence ofdifferentiation according to the query language. For this purpose, ChatGPT andGemini were subjected to a political axis test using 14 different languages.The findings of the study suggest that these large language models do exhibitpolitical tendencies, with both models demonstrating liberal and leftistbiases. A comparative analysis revealed that Gemini exhibited a more pronouncedliberal and left-wing tendency compared to ChatGPT. The study also found thatthese political biases varied depending on the language used for inquiry. Thestudy delves into the factors that constitute political tendencies andlinguistic differentiation, exploring differences in the sources and scope ofeducational data, structural and grammatical features of languages, culturaland political contexts, and the model's response to linguistic features. Fromthis standpoint, and an ethical perspective, it is proposed that artificialintelligence tools should refrain from asserting a lack of political tendenciesand neutrality, instead striving for political neutrality and executing userqueries by incorporating these tendencies.