Abstract
Machine learning approaches hold great potential for the automated detectionof lung nodules in chest radiographs, but training the algorithms requires varylarge amounts of manually annotated images, which are difficult to obtain. Weaklabels indicating whether a radiograph is likely to contain pulmonary nodulesare typically easier to obtain at scale by parsing historical free-textradiological reports associated to the radiographs. Using a repositotory ofover 700,000 chest radiographs, in this study we demonstrate that promisingnodule detection performance can be achieved using weak labels throughconvolutional neural networks for radiograph classification. We propose twonetwork architectures for the classification of images likely to containpulmonary nodules using both weak labels and manually-delineated boundingboxes, when these are available. Annotated nodules are used at training time todeliver a visual attention mechanism informing the model about its localisationperformance. The first architecture extracts saliency maps from high-levelconvolutional layers and compares the estimated position of a nodule againstthe ground truth, when this is available. A corresponding localisation error isthen back-propagated along with the softmax classification error. The secondapproach consists of a recurrent attention model that learns to observe a shortsequence of smaller image portions through reinforcement learning. When anodule annotation is available at training time, the reward function ismodified accordingly so that exploring portions of the radiographs away from anodule incurs a larger penalty. Our empirical results demonstrate the potentialadvantages of these architectures in comparison to competing methodologies.