Abstract
Remote Electrical Tilt (RET) optimization is an efficient method foradjusting the vertical tilt angle of Base Stations (BSs) antennas in order tooptimize Key Performance Indicators (KPIs) of the network. ReinforcementLearning (RL) provides a powerful framework for RET optimization because of itsself-learning capabilities and adaptivity to environmental changes. However, anRL agent may execute unsafe actions during the course of its interaction, i.e.,actions resulting in undesired network performance degradation. Since thereliability of services is critical for Mobile Network Operators (MNOs), theprospect of performance degradation has prohibited the real-world deployment ofRL methods for RET optimization. In this work, we model the RET optimizationproblem in the Safe Reinforcement Learning (SRL) framework with the goal oflearning a tilt control strategy providing performance improvement guaranteeswith respect to a safe baseline. We leverage a recent SRL method, namely SafePolicy Improvement through Baseline Bootstrapping (SPIBB), to learn an improvedpolicy from an offline dataset of interactions collected by the safe baseline.Our experiments show that the proposed approach is able to learn a safe andimproved tilt update policy, providing a higher degree of reliability andpotential for real-world network deployment.