Abstract
With the rise of voice-enabled artificial intelligence (AI) systems,quantitative survey researchers have access to a new data-collection mode: AItelephone surveying. By using AI to conduct phone interviews, researchers canscale quantitative studies while balancing the dual goals of human-likeinteractivity and methodological rigor. Unlike earlier efforts that usedinteractive voice response (IVR) technology to automate these surveys, voice AIenables a more natural and adaptive respondent experience as it is more robustto interruptions, corrections, and other idiosyncrasies of human speech. We built and tested an AI system to conduct quantitative surveys based onlarge language models (LLM), automatic speech recognition (ASR), and speechsynthesis technologies. The system was specifically designed for quantitativeresearch, and strictly adhered to research best practices like question orderrandomization, answer order randomization, and exact wording. To validate the system's effectiveness, we deployed it to conduct two pilotsurveys with the SSRS Opinion Panel and followed-up with a separatehuman-administered survey to assess respondent experiences. We measured threekey metrics: the survey completion rates, break-off rates, and respondentsatisfaction scores. Our results suggest that shorter instruments and moreresponsive AI interviewers may contribute to improvements across all threemetrics studied.