Abstract
Smart services are an important element of the smart cities and the Internetof Things (IoT) ecosystems where the intelligence behind the services isobtained and improved through the sensory data. Providing a large amount oftraining data is not always feasible; therefore, we need to consideralternative ways that incorporate unlabeled data as well. In recent years, Deepreinforcement learning (DRL) has gained great success in several applicationdomains. It is an applicable method for IoT and smart city scenarios whereauto-generated data can be partially labeled by users' feedback for trainingpurposes. In this paper, we propose a semi-supervised deep reinforcementlearning model that fits smart city applications as it consumes both labeledand unlabeled data to improve the performance and accuracy of the learningagent. The model utilizes Variational Autoencoders (VAE) as the inferenceengine for generalizing optimal policies. To the best of our knowledge, theproposed model is the first investigation that extends deep reinforcementlearning to the semi-supervised paradigm. As a case study of smart cityapplications, we focus on smart buildings and apply the proposed model to theproblem of indoor localization based on BLE signal strength. Indoorlocalization is the main component of smart city services since people spendsignificant time in indoor environments. Our model learns the best actionpolicies that lead to a close estimation of the target locations with animprovement of 23% in terms of distance to the target and at least 67% morereceived rewards compared to the supervised DRL model.