Abstract
In swarm robotics, confrontation scenarios, including strategicconfrontations, require efficient decision-making that integrates discretecommands and continuous actions. Traditional task and motion planning methodsseparate decision-making into two layers, but their unidirectional structurefails to capture the interdependence between these layers, limitingadaptability in dynamic environments. Here, we propose a novel bidirectionalapproach based on hierarchical reinforcement learning, enabling dynamicinteraction between the layers. This method effectively maps commands to taskallocation and actions to path planning, while leveraging cross-trainingtechniques to enhance learning across the hierarchical framework. Furthermore,we introduce a trajectory prediction model that bridges abstract taskrepresentations with actionable planning goals. In our experiments, it achievesover 80% in confrontation win rate and under 0.01 seconds in decision time,outperforming existing approaches. Demonstrations through large-scale tests andreal-world robot experiments further emphasize the generalization capabilitiesand practical applicability of our method.