Abstract
Semantic segmentation of eyes has long been a vital pre-processing step inmany biometric applications. Majority of the works focus only on highresolution eye images, while little has been done to segment the eyes from lowquality images in the wild. However, this is a particularly interesting andmeaningful topic, as eyes play a crucial role in conveying the emotional stateand mental well-being of a person. In this work, we take two steps towardsolving this problem: (1) We collect and annotate a challenging eyesegmentation dataset containing 8882 eye patches from 4461 facial images ofdifferent resolutions, illumination conditions and head poses; (2) We develop anovel eye segmentation method, Shape Constrained Network (SCN), thatincorporates shape prior into the segmentation network training procedure.Specifically, we learn the shape prior from our dataset using VAE-GAN, andleverage the pre-trained encoder and discriminator to regularise the trainingof SegNet. To improve the accuracy and quality of predicted masks, we replacethe loss of SegNet with three new losses: Intersection-over-Union (IoU) loss,shape discriminator loss and shape embedding loss. Extensive experiments showsthat our method outperforms state-of-the-art segmentation and landmarkdetection methods in terms of mean IoU (mIoU) accuracy and the quality ofsegmentation masks. The eye segmentation database is available athttps://www.dropbox.com/s/yvveouvxsvti08x/Eye_Segmentation_Database.zip?dl=0.