How can we generate concise explanations for multi-hop Reading Comprehension(RC)? The current strategies of identifying supporting sentences can be seen asan extractive question-focused summarization of the input text. However, theseextractive explanations are not necessarily concise i.e. not minimallysufficient for answering a question. Instead, we advocate for an abstractiveapproach, where we propose to generate a question-focused, abstractive summaryof input paragraphs and then feed it to an RC system. Given a limited amount ofhuman-annotated abstractive explanations, we train the abstractive explainer ina semi-supervised manner, where we start from the supervised model and thentrain it further through trial and error maximizing a conciseness-promotedreward function. Our experiments demonstrate that the proposed abstractiveexplainer can generate more compact explanations than an extractive explainerwith limited supervision (only 2k instances) while maintaining sufficiency.