Abstract
Reasoning is a crucial part of natural language argumentation. To comprehendan argument, one must analyze its warrant, which explains why its claim followsfrom its premises. As arguments are highly contextualized, warrants are usuallypresupposed and left implicit. Thus, the comprehension does not only requirelanguage understanding and logic skills, but also depends on common sense. Inthis paper we develop a methodology for reconstructing warrants systematically.We operationalize it in a scalable crowdsourcing process, resulting in a freelylicensed dataset with warrants for 2k authentic arguments from news comments.On this basis, we present a new challenging task, the argument reasoningcomprehension task. Given an argument with a claim and a premise, the goal isto choose the correct implicit warrant from two options. Both warrants areplausible and lexically close, but lead to contradicting claims. A solution tothis task will define a substantial step towards automatic warrantreconstruction. However, experiments with several neural attention and languagemodels reveal that current approaches do not suffice.