Abstract
Few-shot learning remains challenging for meta-learning that learns alearning algorithm (meta-learner) from many related tasks. In this work, weargue that this is due to the lack of a good representation for meta-learning,and propose deep meta-learning to integrate the representation power of deeplearning into meta-learning. The framework is composed of three modules, aconcept generator, a meta-learner, and a concept discriminator, which arelearned jointly. The concept generator, e.g. a deep residual net, extracts arepresentation for each instance that captures its high-level concept, on whichthe meta-learner performs few-shot learning, and the concept discriminatorrecognizes the concepts. By learning to learn in the concept space rather thanin the complicated instance space, deep meta-learning can substantially improvevanilla meta-learning, which is demonstrated on various few-shot imagerecognition problems. For example, on 5-way-1-shot image recognition onCIFAR-100 and CUB-200, it improves Matching Nets from 50.53% and 56.53% to58.18% and 63.47%, improves MAML from 49.28% and 50.45% to 56.65% and 64.63%,and improves Meta-SGD from 53.83% and 53.34% to 61.62% and 66.95%,respectively.