Abstract

We consider the dynamic multichannel access problem, which can be formulatedas a partially observable Markov decision process (POMDP). We first propose amodel-free actor-critic deep reinforcement learning based framework to explorethe sensing policy. To evaluate the performance of the proposed sensing policyand the framework's tolerance against uncertainty, we test the framework inscenarios with different channel switching patterns and consider differentswitching probabilities. Then, we consider a time-varying environment toidentify the adaptive ability of the proposed framework. Additionally, weprovide comparisons with the Deep-Q network (DQN) based framework proposed in[1], in terms of both average reward and the time efficiency.

 

Quick Read (beta)