Generalized Inner Loop Meta-Learning

  • 2019-10-03 21:41:56
  • Edward Grefenstette, Brandon Amos, Denis Yarats, Phu Mon Htut, Artem Molchanov, Franziska Meier, Douwe Kiela, Kyunghyun Cho, Soumith Chintala
  • 130

Abstract

Many (but not all) approaches self-qualifying as "meta-learning" in deeplearning and reinforcement learning fit a common pattern of approximating thesolution to a nested optimization problem. In this paper, we give aformalization of this shared pattern, which we call GIMLI, prove its generalrequirements, and derive a general-purpose algorithm for implementing similarapproaches. Based on this analysis and algorithm, we describe a library of ourdesign, higher, which we share with the community to assist and enable futureresearch into these kinds of meta-learning approaches. We end the paper byshowcasing the practical applications of this framework and library throughillustrative experiments and ablation studies which they facilitate.

 

Quick Read (beta)

loading the full paper ...