Abstract
Recent advances in graph convolutional networks have significantly improvedthe performance of chemical predictions, raising a new research question: "howdo we explain the predictions of graph convolutional networks?" A possibleapproach to answer this question is to visualize evidence substructuresresponsible for the predictions. For chemical property prediction tasks, thesample size of the training data is often small and/or a label imbalanceproblem occurs, where a few samples belong to a single class and the majorityof samples belong to the other classes. This can lead to uncertainty related tothe learned parameters of the machine learning model. To address thisuncertainty, we propose BayesGrad, utilizing the Bayesian predictivedistribution, to define the importance of each node in an input graph, which iscomputed efficiently using the dropout technique. We demonstrate that BayesGradsuccessfully visualizes the substructures responsible for the label predictionin the artificial experiment, even when the sample size is small. Furthermore,we use a real dataset to evaluate the effectiveness of the visualization. Thebasic idea of BayesGrad is not limited to graph-structured data and can beapplied to other data types.