Abstract
Large Language Models (LLMs) have recently demonstrated significant potentialin the field of time series forecasting, offering impressive capabilities inhandling complex temporal data. However, their robustness and reliability inreal-world applications remain under-explored, particularly concerning theirsusceptibility to adversarial attacks. In this paper, we introduce a targetedadversarial attack framework for LLM-based time series forecasting. Byemploying both gradient-free and black-box optimization methods, we generateminimal yet highly effective perturbations that significantly degrade theforecasting accuracy across multiple datasets and LLM architectures. Ourexperiments, which include models like TimeGPT and LLM-Time with GPT-3.5,GPT-4, LLaMa, and Mistral, show that adversarial attacks lead to much moresevere performance degradation than random noise, and demonstrate the broadeffectiveness of our attacks across different LLMs. The results underscore thecritical vulnerabilities of LLMs in time series forecasting, highlighting theneed for robust defense mechanisms to ensure their reliable deployment inpractical applications.