Abstract

Data augmentation is a widely used technique in many machine learning tasks,such as image classification, to virtually enlarge the training dataset sizeand avoid overfitting. Traditional data augmentation techniques for imageclassification tasks create new samples from the original training data by, forexample, flipping, distorting, adding a small amount of noise to, or cropping apatch from an original image. In this paper, we introduce a simple butsurprisingly effective data augmentation technique for image classificationtasks. With our technique, named SamplePairing, we synthesize a new sample fromone image by overlaying another image randomly chosen from the training data(i.e., taking an average of two images for each pixel). By using two imagesrandomly selected from the training set, we can generate $N^2$ new samples from$N$ training samples. This simple data augmentation technique significantlyimproved classification accuracy for all the tested datasets; for example, thetop-1 error rate was reduced from 33.5% to 29.0% for the ILSVRC 2012 datasetwith GoogLeNet and from 8.22% to 6.93% in the CIFAR-10 dataset. We also showthat our SamplePairing technique largely improved accuracy when the number ofsamples in the training set was very small. Therefore, our technique is morevaluable for tasks with a limited amount of training data, such as medicalimaging tasks.

 

Introduction (beta)

None

 

Conclusion (beta)

None