Abstract
Multi-task reinforcement learning could enable robots to scale across a widevariety of manipulation tasks in homes and workplaces. However, generalizingfrom one task to another and mitigating negative task interference stillremains a challenge. Addressing this challenge by successfully sharinginformation across tasks will depend on how well the structure underlying thetasks is captured. In this work, we introduce our new architecture, ProjectedTask-Specific Layers (PTSL), that leverages a common policy with densetask-specific corrections through task-specific layers to better express sharedand variable task information. We then show that our model outperforms thestate of the art on the MT10 and MT50 benchmarks of Meta-World consisting of 10and 50 goal-conditioned tasks for a Sawyer arm.