Abstract
Purpose: In high-dose-rate (HDR) prostate brachytherapy procedures, thepattern of needle placement solely relies on physician experience. Weinvestigated the feasibility of using reinforcement learning (RL) to provideneedle positions and dwell times based on patient anatomy during pre-planningstage. This approach would reduce procedure time and ensure consistent planquality. Materials and Methods: We train a RL agent to adjust the position ofone selected needle and all the dwell times on it to maximize a pre-definedreward function after observing the environment. After adjusting, the RL agentthen moves on to the next needle, until all needles are adjusted. Multiplerounds are played by the agent until the maximum number of rounds is reached.Plan data from 11 prostate HDR boost patients (1 for training, and 10 fortesting) treated in our clinic were included in this study. The dosimetricmetrics and the number of used needles of RL plan were compared to those of theclinical results (ground truth). Results: On average, RL plans and clinicalplans have very similar prostate coverage (Prostate V100) and Rectum D2cc (nostatistical significance), while RL plans have less prostate hotspot (ProstateV150) and Urethra D20% plans with statistical significance. Moreover, RL plansuse 2 less needles than clinical plan on average. Conclusion: We present thefirst study demonstrating the feasibility of using reinforcement learning toautonomously generate clinically practical HDR prostate brachytherapy plans.This RL-based method achieved equal or improved plan quality compared toconventional clinical approaches while requiring fewer needles. With minimaldata requirements and strong generalizability, this approach has substantialpotential to standardize brachytherapy planning, reduce clinical variability,and enhance patient outcomes.