Meta-Learning for Semi-Supervised Few-Shot Classification

  • 2018-03-02 01:07:49
  • Mengye Ren, Eleni Triantafillou, Sachin Ravi, Jake Snell, Kevin Swersky, Joshua B. Tenenbaum, Hugo Larochelle, Richard S. Zemel
  • 82


In few-shot classification, we are interested in learning algorithms thattrain a classifier from only a handful of labeled examples. Recent progress infew-shot classification has featured meta-learning, in which a parameterizedmodel for a learning algorithm is defined and trained on episodes representingdifferent classification problems, each with a small labeled training set andits corresponding test set. In this work, we advance this few-shotclassification paradigm towards a scenario where unlabeled examples are alsoavailable within each episode. We consider two situations: one where allunlabeled examples are assumed to belong to the same set of classes as thelabeled examples of the episode, as well as the more challenging situationwhere examples from other distractor classes are also provided. To address thisparadigm, we propose novel extensions of Prototypical Networks (Snell et al.,2017) that are augmented with the ability to use unlabeled examples whenproducing prototypes. These models are trained in an end-to-end way onepisodes, to learn to leverage the unlabeled examples successfully. We evaluatethese methods on versions of the Omniglot and miniImageNet benchmarks, adaptedto this new framework augmented with unlabeled examples. We also propose a newsplit of ImageNet, consisting of a large set of classes, with a hierarchicalstructure. Our experiments confirm that our Prototypical Networks can learn toimprove their predictions due to unlabeled examples, much like asemi-supervised algorithm would.


Introduction (beta)



Conclusion (beta)