Abstract
Global partisan hostility and polarization has increased, and thispolarization is heightened around presidential elections. Models capable ofgenerating accurate summaries of diverse perspectives can help reduce suchpolarization by exposing users to alternative perspectives. In this work, weintroduce a novel dataset and task for independently summarizing each politicalperspective in a set of passages from opinionated news articles. For this task,we propose a framework for evaluating different dimensions of perspectivesummary performance. We benchmark 10 models of varying sizes and architecturesthrough both automatic and human evaluation. While recent models like GPT-4operform well on this task, we find that all models struggle to generatesummaries faithful to the intended perspective. Our analysis of summariesfocuses on how extraction behavior depends on the features of the inputdocuments.