Abstract
Top-down saliency models produce a probability map that peaks at targetlocations specified by a task/goal such as object detection. They are usuallytrained in a fully supervised setting involving pixel-level annotations ofobjects. We propose a weakly supervised top-down saliency framework using onlybinary labels that indicate the presence/absence of an object in an image.First, the probabilistic contribution of each image region to the confidence ofa CNN-based image classifier is computed through a backtracking strategy toproduce top-down saliency. From a set of saliency maps of an image produced byfast bottom-up saliency approaches, we select the best saliency map suitablefor the top-down task. The selected bottom-up saliency map is combined with thetop-down saliency map. Features having high combined saliency are used to traina linear SVM classifier to estimate feature saliency. This is integrated withcombined saliency and further refined through a multi-scalesuperpixel-averaging of saliency map. We evaluate the performance of theproposed weakly supervised topdown saliency and achieve comparable performancewith fully supervised approaches. Experiments are carried out on sevenchallenging datasets and quantitative results are compared with 40 closelyrelated approaches across 4 different applications.