Reinforcement learning (RL) has achieved state-of-the-art performance in manyscientific and applied problems. However, some complex tasks still aredifficult to handle using a single model and algorithm. The highly popularensemble reinforcement learning (ERL) has become an important method to handlecomplex tasks with the advantage of combining reinforcement learning andensemble learning (EL). ERL combines several models or training algorithms tofully explore the problem space and has strong generalization characteristics.This study presents a comprehensive survey on ERL to provide the readers withan overview of the recent advances and challenges. The background is introducedfirst. The strategies successfully applied in ERL are analyzed in detail.Finally, we outline some open questions and conclude by discussing some futureresearch directions of ERL. This survey contributes to ERL development byproviding a guide for future scientific research and engineering applications.