Abstract
We have seen much recent progress in rigid object manipulation, butinteraction with deformable objects has notably lagged behind. Due to the largeconfiguration space of deformable objects, solutions using traditionalmodelling approaches require significant engineering work. Perhaps then,bypassing the need for explicit modelling and instead learning the control inan end-to-end manner serves as a better approach? Despite the growing interestin the use of end-to-end robot learning approaches, only a small amount of workhas focused on their applicability to deformable object manipulation. Moreover,due to the large amount of data needed to learn these end-to-end solutions, anemerging trend is to learn to control policies in simulation and then transferthem over to the real world. To-date, no work has explored whether it ispossible to learn and transfer deformable object policies. We believe that ifsim-to-real methods are the way forward, then it should be possible to learn tointeract with a wide variety of objects, and not just rigid objects. In thiswork, we use a combination of state-of-the-art deep reinforcement learningalgorithms to solve the problem of manipulating deformable objects(specifically cloth). We evaluate our approach on three tasks --- folding atowel up to a mark, folding a face towel diagonally, and draping a piece ofcloth over a hanger. Our agents are fully trained in simulation with domainrandomisation, and then successfully deployed in the real world without havingseen any real deformable objects.