Abstract
Reinforcement learning is a model-free optimal control method that optimizesa control policy through direct interaction with the environment. For reachingtasks that end in regulation, popular discrete-action methods are not wellsuited due to chattering in the goal state. We compare three different ways tosolve this problem through combining reinforcement learning with classical LQRcontrol. In particular, we introduce a method that integrates LQR control intothe action set, allowing generalization and avoiding fixing the computedcontrol in the replay memory if it is based on learned dynamics. We also embedLQR control into a continuous-action method. In all cases, we show that addingLQR control can improve performance, although the effect is more profound if itcan be used to augment a discrete action set.