Abstract
During their first years of life, infants learn the language(s) of theirenvironment at an amazing speed despite large cross cultural variations inamount and complexity of the available language input. Understanding thissimple fact still escapes current cognitive and linguistic theories. Recently,spectacular progress in the engineering science, notably, machine learning andwearable technology, offer the promise of revolutionizing the study ofcognitive development. Machine learning offers powerful learning algorithmsthat can achieve human-like performance on many linguistic tasks. Wearablesensors can capture vast amounts of data, which enable the reconstruction ofthe sensory experience of infants in their natural environment. The project of'reverse engineering' language development, i.e., of building an effectivesystem that mimics infant's achievements appears therefore to be within reach.Here, we analyze the conditions under which such a project can contribute toour scientific understanding of early language development. We argue thatinstead of defining a sub-problem or simplifying the data, computational modelsshould address the full complexity of the learning situation, and take as inputthe raw sensory signals available to infants. This implies that (1) accessiblebut privacy-preserving repositories of home data be setup and widely shared,and (2) models be evaluated at different linguistic levels through a benchmarkof psycholinguist tests that can be passed by machines and humans alike, (3)linguistically and psychologically plausible learning architectures be scaledup to real data using probabilistic/optimization principles from machinelearning. We discuss the feasibility of this approach and present preliminaryresults.