Abstract
Recent commonsense-reasoning tasks are typically discriminative in nature,where a model answers a multiple-choice question for a certain context.Discriminative tasks are limiting because they fail to adequately evaluate themodel's ability to reason and explain predictions with underlying commonsenseknowledge. They also allow such models to use reasoning shortcuts and not be"right for the right reasons". In this work, we present ExplaGraphs, a newgenerative and structured commonsense-reasoning task (and an associateddataset) of explanation graph generation for stance prediction. Specifically,given a belief and an argument, a model has to predict whether the argumentsupports or counters the belief and also generate a commonsense-augmented graphthat serves as non-trivial, complete, and unambiguous explanation for thepredicted stance. The explanation graphs for our dataset are collected viacrowdsourcing through a novel Collect-Judge-And-Refine graph collectionframework that improves the graph quality via multiple rounds of verificationand refinement. A significant 83% of our graphs contain external commonsensenodes with diverse structures and reasoning depths. We also propose amulti-level evaluation framework that checks for the structural and semanticcorrectness of the generated graphs and their plausibility with human-writtengraphs. We experiment with state-of-the-art text generation models like BARTand T5 to generate explanation graphs and observe that there is a large gapwith human performance, thereby encouraging useful future work for this newcommonsense graph-based explanation generation task.