Abstract
Robotic insertion tasks are characterized by contact and friction mechanics,making them challenging for conventional feedback control methods due tounmodeled physical effects. Reinforcement learning (RL) is a promising approachfor learning control policies in such settings. However, RL can be unsafeduring exploration and might require a large amount of real-world trainingdata, which is expensive to collect. In this paper, we study how to usemeta-reinforcement learning to solve the bulk of the problem in simulation bysolving a family of simulated industrial insertion tasks and then adaptpolicies quickly in the real world. We demonstrate our approach by training anagent to successfully perform challenging real-world insertion tasks using lessthan 20 trials of real-world experience.