Abstract
Reconfigurable intelligent surface (RIS) becomes a promising technique for 6Gnetworks by reshaping signal propagation in smart radio environments. However,it also leads to significant complexity for network management due to the largenumber of elements and dedicated phase-shift optimization. In this work, weprovide an overview of machine learning (ML)-enabled optimization for RIS-aided6G networks. In particular, we focus on various reinforcement learning (RL)techniques, e.g., deep Q-learning, multi-agent reinforcement learning, transferreinforcement learning, hierarchical reinforcement learning, and offlinereinforcement learning. Different from existing studies, this work furtherdiscusses how large language models (LLMs) can be combined with RL to handlenetwork optimization problems. It shows that LLM offers new opportunities toenhance the capabilities of RL algorithms in terms of generalization, rewardfunction design, multi-modal information processing, etc. Finally, we identifythe future challenges and directions of ML-enabled optimization for RIS-aided6G networks.