Drones are becoming versatile in a myriad of applications. This has led tothe use of drones for spying and intruding into the restricted or private airspaces. Such foul use of drone technology is dangerous for the safety andsecurity of many critical infrastructures. In addition, due to the variedlow-cost design and agility of the drones, it is a challenging task to identifyand track them using the conventional radar systems. In this paper, we proposea reinforcement learning based approach for identifying and tracking anyintruder drone using a chaser drone. Our proposed solution uses computer visiontechniques interleaved with the policy learning framework of reinforcementlearning to learn a control policy for chasing the intruder drone. The wholesystem has been implemented using ROS and Gazebo along with the Ardupilot basedflight controller. The results show that the reinforcement learning basedpolicy converges to identify and track the intruder drone. Further, the learntpolicy is robust with respect to the change in speed or orientation of theintruder drone.