Abstract
Abductive reasoning is inference to the most plausible explanation. Forexample, if Jenny finds her house in a mess when she returns from work, andremembers that she left a window open, she can hypothesize that a thief brokeinto her house and caused the mess, as the most plausible explanation. Whileabduction has long been considered to be at the core of how people interpretand read between the lines in natural language (Hobbs et al., 1988), there hasbeen relatively little research in support of abductive natural languageinference and generation. We present the first study that investigates theviability of language-based abductive reasoning. We introduce a challengedataset, ART, that consists of over 20k commonsense narrative contexts and 200kexplanations. Based on this dataset, we conceptualize two new tasks -- (i)Abductive NLI: a multiple-choice question answering task for choosing the morelikely explanation, and (ii) Abductive NLG: a conditional generation task forexplaining given observations in natural language. On Abductive NLI, the bestmodel achieves 68.9% accuracy, well below human performance of 91.4%. OnAbductive NLG, the current best language generators struggle even more, as theylack reasoning capabilities that are trivial for humans. Our analysis leads tonew insights into the types of reasoning that deep pre-trained language modelsfail to perform--despite their strong performance on the related but morenarrowly defined task of entailment NLI--pointing to interesting avenues forfuture research.