Activation Landscapes as a Topological Summary of Neural Network Performance

  • 2021-10-19 17:45:36
  • Matthew Wheeler, Jose Bouza, Peter Bubenik
  • 1

Abstract

We use topological data analysis (TDA) to study how data transforms as itpasses through successive layers of a deep neural network (DNN). We compute thepersistent homology of the activation data for each layer of the network andsummarize this information using persistence landscapes. The resulting featuremap provides both an informative visual- ization of the network and a kernelfor statistical analysis and machine learning. We observe that the topologicalcomplexity often increases with training and that the topological complexitydoes not decrease with each layer.

 

Quick Read (beta)

loading the full paper ...