Measuring Disagreement in Science

  • 2021-07-30 14:07:34
  • Wout S. Lamers, Kevin Boyack, Vincent Larivière, Cassidy R. Sugimoto, Nees Jan van Eck, Ludo Waltman, Dakota Murray
  • 45


Disagreement is essential to scientific progress. However, the extent ofdisagreement in science, its evolution over time, and the fields in which ithappens, remains largely unknown. Leveraging a massive collection of scientifictexts, we develop a cue-phrase based approach to identify instances ofdisagreement citations across more than four million scientific articles. Usingthis method, we construct an indicator of disagreement across scientific fieldsover the 2000-2015 period. In contrast with black-box text classificationmethods, our framework is transparent and easily interpretable. We reveal adisciplinary spectrum of disagreement, with higher disagreement in the socialsciences and lower disagreement in physics and mathematics. However, detaileddisciplinary analysis demonstrates heterogeneity across sub-fields, revealingthe importance of local disciplinary cultures and epistemic characteristics ofdisagreement. Paper-level analysis reveals notable episodes of disagreement inscience, and illustrates how methodological artefacts can confound analyses ofscientific texts. These findings contribute to a broader understanding ofdisagreement and establish a foundation for future research to understandingkey processes underlying scientific progress.


Quick Read (beta)

loading the full paper ...