Abstract
Technological trends show that Radio Frequency Reinforcement Learning (RFRL)will play a prominent role in the wireless communication systems of the future.Applications of RFRL range from military communications jamming to enhancingWiFi networks. Before deploying algorithms for these purposes, they must betrained in a simulation environment to ensure adequate performance. For thisreason, we previously created the RFRL Gym: a standardized, accessible tool forthe development and testing of reinforcement learning (RL) algorithms in thewireless communications space. This environment leveraged the OpenAI Gymframework and featured customizable simulation scenarios within the RFspectrum. However, the RFRL Gym was limited to training a single RL agent persimulation; this is not ideal, as most real-world RF scenarios will containmultiple intelligent agents in cooperative, competitive, or mixed settings,which is a natural consequence of spectrum congestion. Therefore, throughintegration with Ray RLlib, multi-agent reinforcement learning (MARL)functionality for training and assessment has been added to the RFRL Gym,making it even more of a robust tool for RF spectrum simulation. This paperprovides an overview of the updated RFRL Gym environment. In this work, thegeneral framework of the tool is described relative to comparable existingresources, highlighting the significant additions and refactoring we haveapplied to the Gym. Afterward, results from testing various RF scenarios in theMARL environment and future additions are discussed.