Task-Agnostic Morphology Evolution

  • 2021-02-25 18:59:21
  • Donald J. Hejna III, Pieter Abbeel, Lerrel Pinto
  • 30

Abstract

Deep reinforcement learning primarily focuses on learning behavior, usuallyoverlooking the fact that an agent's function is largely determined by form.So, how should one go about finding a morphology fit for solving tasks in agiven environment? Current approaches that co-adapt morphology and behavior usea specific task's reward as a signal for morphology optimization. However, thisoften requires expensive policy optimization and results in task-dependentmorphologies that are not built to generalize. In this work, we propose a newapproach, Task-Agnostic Morphology Evolution (TAME), to alleviate both of theseissues. Without any task or reward specification, TAME evolves morphologies byonly applying randomly sampled action primitives on a population of agents.This is accomplished using an information-theoretic objective that efficientlyranks agents by their ability to reach diverse states in the environment andthe causality of their actions. Finally, we empirically demonstrate that across2D, 3D, and manipulation environments TAME can evolve morphologies that matchthe multi-task performance of those learned with task supervised algorithms.Our code and videos can be found athttps://sites.google.com/view/task-agnostic-evolution.

 

Quick Read (beta)

loading the full paper ...