Abstract
In recent research, large language models (LLMs) have been increasingly usedto investigate public opinions. This study investigates the algorithmicfidelity of LLMs, i.e., the ability to replicate the socio-cultural context andnuanced opinions of human participants. Using open-ended survey data from theGerman Longitudinal Election Studies (GLES), we prompt different LLMs togenerate synthetic public opinions reflective of German subpopulations byincorporating demographic features into the persona prompts. Our results showthat Llama performs better than other LLMs at representing subpopulations,particularly when there is lower opinion diversity within those groups. Ourfindings further reveal that the LLM performs better for supporters ofleft-leaning parties like The Greens and The Left compared to other parties,and matches the least with the right-party AfD. Additionally, the inclusion orexclusion of specific variables in the prompts can significantly impact themodels' predictions. These findings underscore the importance of aligning LLMsto more effectively model diverse public opinions while minimizing politicalbiases and enhancing robustness in representativeness.