Abstract
We present a fully autonomous real-world RL framework for mobile manipulationthat can learn policies without extensive instrumentation or human supervision.This is enabled by 1) task-relevant autonomy, which guides exploration towardsobject interactions and prevents stagnation near goal states, 2) efficientpolicy learning by leveraging basic task knowledge in behavior priors, and 3)formulating generic rewards that combine human-interpretable semanticinformation with low-level, fine-grained observations. We demonstrate that ourapproach allows Spot robots to continually improve their performance on a setof four challenging mobile manipulation tasks, obtaining an average successrate of 80% across tasks, a 3-4 improvement over existing approaches. Videoscan be found at https://continual-mobile-manip.github.io/