Abstract

In this article, we sketch an algorithm that extends the Q-learningalgorithms to the continuous action space domain. Our method is based on thediscretization of the action space. Despite the commonly used discretizationmethods, our method does not increase the discretized problem dimensionalityexponentially. We will show that our proposed method is linear in complexitywhen the discretization is employed. The variant of the Q-learning algorithmpresented in this work, labeled as Finite Step Q-Learning (FSQ), can bedeployed to both shallow and deep neural network architectures.

 

Quick Read (beta)