Abstract
Optimization of hyper-parameters in reinforcement learning (RL) algorithms isa key task, because they determine how the agent will learn its policy byinteracting with its environment, and thus what data is gathered. In this work,an approach that uses Bayesian optimization to perform a two-step optimizationis proposed: first, categorical RL structure hyper-parameters are taken asbinary variables and optimized with an acquisition function tailored for suchvariables. Then, at a lower level of abstraction, solution-levelhyper-parameters are optimized by resorting to the expected improvementacquisition function, while using the best categorical hyper-parameters foundin the optimization at the upper-level of abstraction. This two-tier approachis validated in a simulated control task. Results obtained are promising andopen the way for more user-independent applications of reinforcement learning.