Summarize-then-Answer: Generating Concise Explanations for Multi-hop Reading Comprehension

  • 2021-09-14 17:44:34
  • Naoya Inoue, Harsh Trivedi, Steven Sinha, Niranjan Balasubramanian, Kentaro Inui
  • 5

Abstract

How can we generate concise explanations for multi-hop Reading Comprehension(RC)? The current strategies of identifying supporting sentences can be seen asan extractive question-focused summarization of the input text. However, theseextractive explanations are not necessarily concise i.e. not minimallysufficient for answering a question. Instead, we advocate for an abstractiveapproach, where we propose to generate a question-focused, abstractive summaryof input paragraphs and then feed it to an RC system. Given a limited amount ofhuman-annotated abstractive explanations, we train the abstractive explainer ina semi-supervised manner, where we start from the supervised model and thentrain it further through trial and error maximizing a conciseness-promotedreward function. Our experiments demonstrate that the proposed abstractiveexplainer can generate more compact explanations than an extractive explainerwith limited supervision (only 2k instances) while maintaining sufficiency.

 

Quick Read (beta)

loading the full paper ...