Abstract

The goal of meta-learning is to train a model on a variety of learning tasks,such that it can adapt to new problems within only a few iterations. Here wepropose a principled information-theoretic model that optimally partitions theunderlying problem space such that the resulting partitions are processed byspecialized expert decision-makers. To drive this specialization we impose thesame kind of information processing constraints both on the partitioning andthe expert decision-makers. We argue that this specialization leads toefficient adaptation to new tasks. To demonstrate the generality of ourapproach we evaluate on three meta-learning domains: image classification,regression, and reinforcement learning.

 

Quick Read (beta)