Abstract
Interaction between caregivers and children plays a critical role in humanlanguage acquisition and development. Given this observation, it is remarkablethat explicit interaction plays little to no role in artificial languagemodeling -- which also targets the acquisition of human language, yet byartificial models. Moreover, an interactive approach to language modeling hasthe potential to make language models substantially more versatile and toconsiderably impact downstream applications. Motivated by these considerations,we pioneer the space of interactive language modeling. As a first contributionwe present a road map in which we detail the steps that need to be takentowards interactive language modeling. We then lead by example and take thefirst steps on this road map, showing the initial feasibility of our approach.As such, this work aims to be the start of a larger research agenda oninteractive language modeling.