Abstract
This paper introduces SHANGUS, an advanced framework combining DeepReinforcement Learning (DRL) with heuristic optimization to improvefrontier-based exploration efficiency in unknown environments, particularly forintelligent vehicles in autonomous air services, search and rescue operations,and space exploration robotics. SHANGUS harnesses DRL's adaptability andheuristic prioritization, markedly enhancing exploration efficiency, reducingcompletion time, and minimizing travel distance. The strategy involves afrontier selection node to identify unexplored areas and a DRL navigation nodeusing the Twin Delayed Deep Deterministic Policy Gradient (TD3) algorithm forrobust path planning and dynamic obstacle avoidance. Extensive experiments inROS2 and Gazebo simulation environments show SHANGUS surpasses representativetraditional methods like the Nearest Frontier (NF), Novel Frontier-BasedExploration Algorithm (CFE), and Goal-Driven Autonomous Exploration (GDAE)algorithms, especially in complex scenarios, excelling in completion time,travel distance, and exploration rate. This scalable solution is suitable forreal-time autonomous navigation in fields such as industrial automation,autonomous driving, household robotics, and space exploration. Future researchwill integrate additional sensory inputs and refine heuristic functions tofurther boost SHANGUS's efficiency and robustness.