Abstract

We consider undiscounted reinforcement learning in Markov decision processes(MDPs) where both the reward functions and the state-transition probabilitiesmay vary (gradually or abruptly) over time. For this problem setting, wepropose an algorithm and provide performance guarantees for the regretevaluated against the optimal non-stationary policy. The upper bound on theregret is given in terms of the total variation in the MDP. This is the firstvariational regret bound for the general reinforcement learning setting.

 

Quick Read (beta)