Abstract
Soft real-time applications are becoming increasingly complex, posingsignificant challenges for scheduling offloaded tasks in edge computingenvironments while meeting task timing constraints. Moreover, the exponentialgrowth of the search space, presence of multiple objectives and parameters, andhighly dynamic nature of edge computing environments further exacerbate thecomplexity of task scheduling. As a result, schedulers based on heuristic andmetaheuristic algorithms frequently encounter difficulties in generatingoptimal or near-optimal task schedules due to their constrained ability toadapt to the dynamic conditions and complex environmental characteristics ofedge computing. Accordingly, reinforcement learning algorithms have beenincorporated into schedulers to address the complexity and dynamic conditionsinherent in task scheduling in edge computing. However, a significantlimitation of reinforcement learning algorithms is the prolonged learning timerequired to adapt to new environments and to address medium- and large-scaleproblems. This challenge arises from the extensive global action space andfrequent random exploration of irrelevant actions. Therefore, this studyproposes Agile Reinforcement learning (aRL), in which the RL-agent performsinformed exploration and executes only relevant actions. Consequently, thepredictability of the RL-agent is enhanced, leading to rapid adaptation andconvergence, which positions aRL as a suitable candidate for scheduling thetasks of soft real-time applications in edge computing. The experimentsdemonstrate that the combination of informed exploration and action-maskingmethods enables aRL to achieve a higher hit-ratio and converge faster than thebaseline approaches.