MACS: Deep Reinforcement Learning based SDN Controller Synchronization Policy Design

  • 2019-09-19 16:01:43
  • Ziyao Zhang, Liang Ma, Konstantinos Poularakis, Kin K. Leung, Jeremy Tucker, Ananthram Swami
  • 0

Abstract

In distributed software-defined networks (SDN), multiple physical SDNcontrollers, each managing a network domain, are implemented to balancecentralised control, scalability, and reliability requirements. In suchnetworking paradigms, controllers synchronize with each other, in attempts tomaintain a logically centralised network view. Despite the presence of variousdesign proposals for distributed SDN controller architectures, most existingworks only aim at eliminating anomalies arising from the inconsistencies indifferent controllers' network views. However, the performance aspect ofcontroller synchronization designs with respect to given SDN applications aregenerally missing. To fill this gap, we formulate the controllersynchronization problem as a Markov decision process (MDP) and applyreinforcement learning techniques combined with deep neural networks (DNNs) totrain a smart, scalable, and fine-grained controller synchronization policy,called the Multi-Armed Cooperative Synchronization (MACS), whose goal is tomaximise the performance enhancements brought by controller synchronizations.Evaluation results confirm the DNN's exceptional ability in abstracting latentpatterns in the distributed SDN environment, rendering significant superiorityto MACS-based synchronization policy, which are 56% and 30% performanceimprovements over ONOS and greedy SDN controller synchronization heuristics.

 

Quick Read (beta)

loading the full paper ...