Abstract
After a surge in popularity of supervised Deep Learning, the desire to reducethe dependence on curated, labelled data sets and to leverage the vastquantities of unlabelled data available recently triggered renewed interest inunsupervised learning algorithms. Despite a significantly improved performancedue to approaches such as the identification of disentangled latentrepresentations, contrastive learning, and clustering optimisations, theperformance of unsupervised machine learning still falls short of itshypothesised potential. Machine learning has previously taken inspiration fromneuroscience and cognitive science with great success. However, this has mostlybeen based on adult learners with access to labels and a vast amount of priorknowledge. In order to push unsupervised machine learning forward, we arguethat developmental science of infant cognition might hold the key to unlockingthe next generation of unsupervised learning approaches. Conceptually, humaninfant learning is the closest biological parallel to artificial unsupervisedlearning, as infants too must learn useful representations from unlabelleddata. In contrast to machine learning, these new representations are learnedrapidly and from relatively few examples. Moreover, infants learn robustrepresentations that can be used flexibly and efficiently in a number ofdifferent tasks and contexts. We identify five crucial factors enablinginfants' quality and speed of learning, assess the extent to which these havealready been exploited in machine learning, and propose how further adoption ofthese factors can give rise to previously unseen performance levels inunsupervised learning.