Abstract

In this manuscript, we show that any neural network having piece-wise linearactivation functions can be represented as a decision tree. The representationis equivalence and not an approximation, thus keeping the accuracy of theneural network exactly as is. This equivalence shows that neural networks areindeed interpretable by design and makes the \textit{black-box} understandingobsolete. We share equivalent trees of some neural networks and show thatbesides providing interpretability, tree representation can also achieve somecomputational advantages. The analysis holds both for fully connected andconvolutional networks, which may or may not also include skip connectionsand/or normalizations.

 

Quick Read (beta)