Abstract

Reinforcement Learning is a powerful tool to model decision-making processes.However, it relies on an exploration-exploitation trade-off that remains anopen challenge for many tasks. In this work, we study neighboring state-based,model-free exploration led by the intuition that, for an early-stage agent,considering actions derived from a bounded region of nearby states may lead tobetter actions when exploring. We propose two algorithms that chooseexploratory actions based on a survey of nearby states, and find that one ofour methods, ${\rho}$-explore, consistently outperforms the Double DQN baselinein an discrete environment by 49% in terms of Eval Reward Return.

 

Quick Read (beta)