Abstract
Representation learning algorithms are designed to learn abstract featuresthat characterize data. State representation learning (SRL) focuses on aparticular kind of representation learning where learned features are in lowdimension, evolve through time, and are influenced by actions of an agent. Asthe representation learned captures the variation in the environment generatedby agents, this kind of representation is particularly suitable for roboticsand control scenarios. In particular, the low dimension helps to overcome thecurse of dimensionality, provides easier interpretation and utilization byhumans and can help improve performance and speed in policy learning algorithmssuch as reinforcement learning. This survey aims at covering the state-of-the-art on state representationlearning in the most recent years. It reviews different SRL methods thatinvolve interaction with the environment, their implementations and theirapplications in robotics control tasks (simulated or real). In particular, ithighlights how generic learning objectives are differently exploited in thereviewed algorithms. Finally, it discusses evaluation methods to assess therepresentation learned and summarizes current and future lines of research.