Abstract
Reinforcement learning (RL) agents typically assume stationary environmentdynamics. Yet in real-world applications such as healthcare, robotics, andfinance, transition probabilities or reward functions may evolve, leading tomodel drift. This paper proposes a novel framework to detect such drifts byanalyzing the distributional changes in sequences of agent behavior.Specifically, we introduce a suite of edit operation-based measures to quantifydeviations between state-action trajectories generated under stationary andperturbed conditions. Our experiments demonstrate that these measures caneffectively distinguish drifted from non-drifted scenarios, even under varyinglevels of noise, providing a practical tool for drift detection innon-stationary RL environments.