Robust localization of organs in computed tomography scans is a constantpre-processing requirement for organ-specific image retrieval, radiotherapyplanning, and interventional image analysis. In contrast to current solutionsbased on exhaustive search or region proposals, which require large amounts ofannotated data, we propose a deep reinforcement learning approach for organlocalization in CT. In this work, an artificial agent is actively self-taughtto localize organs in CT by learning from its asserts and mistakes. Within thecontext of reinforcement learning, we propose a novel set of actions tailoredfor organ localization in CT. Our method can use as a plug-and-play module forlocalizing any organ of interest. We evaluate the proposed solution on thepublic VISCERAL dataset containing CT scans with varying fields of view andmultiple organs. We achieved an overall intersection over union of 0.63, anabsolute median wall distance of 2.25 mm, and a median distance betweencentroids of 3.65 mm.