Policy Disruption in Reinforcement Learning:Adversarial Attack with Large Language Models and Critical State Identification

  • 2025-07-24 05:52:06
  • Junyong Jiang, Buwei Tian, Chenxing Xu, Songze Li, Lu Dong
  • 0

Abstract

Reinforcement learning (RL) has achieved remarkable success in fields likerobotics and autonomous driving, but adversarial attacks designed to mislead RLsystems remain challenging. Existing approaches often rely on modifying theenvironment or policy, limiting their practicality. This paper proposes anadversarial attack method in which existing agents in the environment guide thetarget policy to output suboptimal actions without altering the environment. Wepropose a reward iteration optimization framework that leverages large languagemodels (LLMs) to generate adversarial rewards explicitly tailored to thevulnerabilities of the target agent, thereby enhancing the effectiveness ofinducing the target agent toward suboptimal decision-making. Additionally, acritical state identification algorithm is designed to pinpoint the targetagent's most vulnerable states, where suboptimal behavior from the victim leadsto significant degradation in overall performance. Experimental results indiverse environments demonstrate the superiority of our method over existingapproaches.

 

Quick Read (beta)

loading the full paper ...