State-of-Art-Reviewing: A Radical Proposal to Improve Scientific Publication

  • 2020-03-31 17:58:36
  • Samuel Albanie, Jaime Thewmore, Robert McCraith, Joao F. Henriques
  • 109

Abstract

Peer review forms the backbone of modern scientific manuscript evaluation.But after two hundred and eighty-nine years of egalitarian service to thescientific community, does this protocol remain fit for purpose in 2020? Inthis work, we answer this question in the negative (strong reject, highconfidence) and propose instead State-Of-the-Art Review (SOAR), a neotericreviewing pipeline that serves as a 'plug-and-play' replacement for peerreview. At the heart of our approach is an interpretation of the review processas a multi-objective, massively distributed and extremely-high-latencyoptimisation, which we scalarise and solve efficiently for PAC and CMT-optimalsolutions. We make the following contributions: (1) We propose a highlyscalable, fully automatic methodology for review, drawing inspiration frombest-practices from premier computer vision and machine learning conferences;(2) We explore several instantiations of our approach and demonstrate that SOARcan be used to both review prints and pre-review pre-prints; (3) We wanderlistlessly in vain search of catharsis from our latest rounds of savage CVPRrejections.

 

Quick Read (beta)

loading the full paper ...