Abstract
Sparse Mobile CrowdSensing (MCS) is a novel MCS paradigm where data inferenceis incorporated into the MCS process for reducing sensing costs while itsquality is guaranteed. Since the sensed data from different cells (sub-areas)of the target sensing area will probably lead to diverse levels of inferencedata quality, cell selection (i.e., choose which cells of the target area tocollect sensed data from participants) is a critical issue that will impact thetotal amount of data that requires to be collected (i.e., data collectioncosts) for ensuring a certain level of quality. To address this issue, thispaper proposes a Deep Reinforcement learning based Cell selection mechanism forSparse MCS, called DR-Cell. First, we properly model the key concepts inreinforcement learning including state, action, and reward, and then propose touse a deep recurrent Q-network for learning the Q-function that can help decidewhich cell is a better choice under a certain state during cell selection.Furthermore, we leverage the transfer learning techniques to reduce the amountof data required for training the Q-function if there are multiple correlatedMCS tasks that need to be conducted in the same target area. Experiments onvarious real-life sensing datasets verify the effectiveness of DR-Cell over thestate-of-the-art cell selection mechanisms in Sparse MCS by reducing up to 15%of sensed cells with the same data inference quality guarantee.