Reinforcement Learning with Budget-Constrained Nonparametric Function Approximation for Opportunistic Spectrum Access

  • 2018-06-20 19:46:21
  • Theodoros Tsiligkaridis, David Romero
  • 0

Abstract

Opportunistic spectrum access is one of the emerging techniques formaximizing throughput in congested bands and is enabled by predicting idleslots in spectrum. We propose a kernel-based reinforcement learning approachcoupled with a novel budget-constrained sparsification technique thatefficiently captures the environment to find the best channel access actions.This approach allows learning and planning over the intrinsic state-actionspace and extends well to large state spaces. We apply our methods to evaluatecoexistence of a reinforcement learning-based radio with a multi-channeladversarial radio and a single-channel CSMA-CA radio. Numerical experimentsshow the performance gains over carrier-sense systems.

 

Quick Read (beta)

loading the full paper ...