Abstract
Reinforcement learning (RL) has been used in a range of simulated real-worldtasks, e.g., sensor coordination, traffic light control, and on-demand mobilityservices. However, real world deployments are rare, as RL struggles withdynamic nature of real world environments, requiring time for learning a taskand adapting to changes in the environment. Transfer Learning (TL) can helplower these adaptation times. In particular, there is a significant potentialof applying TL in multi-agent RL systems, where multiple agents can shareknowledge with each other, as well as with new agents that join the system. Toobtain the most from inter-agent transfer, transfer roles (i.e., determiningwhich agents act as sources and which as targets), as well as relevant transfercontent parameters (e.g., transfer size) should be selected dynamically in eachparticular situation. As a first step towards fully dynamic transfers, in thispaper we investigate the impact of TL transfer parameters with fixed source andtarget roles. Specifically, we label every agent-environment interaction withagent's epistemic confidence, and we filter the shared examples using varyingthreshold levels and sample sizes. We investigate impact of these parameters intwo scenarios, a standard predator-prey RL benchmark and a simulation of aride-sharing system with 200 vehicle agents and 10,000 ride-requests.