Multiview Detection with Feature Perspective Transformation

  • 2020-07-14 17:58:30
  • Yunzhong Hou, Liang Zheng, Stephen Gould
  • 4

Abstract

Incorporating multiple camera views for detection alleviates the impact ofocclusions in crowded scenes. In a multiview system, we need to answer twoimportant questions when dealing with ambiguities that arise from occlusions.First, how should we aggregate cues from the multiple views? Second, how shouldwe aggregate unreliable 2D and 3D spatial information that has been tainted byocclusions? To address these questions, we propose a novel multiview detectionsystem, MVDet. For multiview aggregation, existing methods combine anchor boxfeatures from the image plane, which potentially limits performance due toinaccurate anchor box shapes and sizes. In contrast, we take an anchor-freeapproach to aggregate multiview information by projecting feature maps onto theground plane (bird's eye view). To resolve any remaining spatial ambiguity, weapply large kernel convolutions on the ground plane feature map and inferlocations from detection peaks. Our entire model is end-to-end learnable andachieves 88.2% MODA on the standard Wildtrack dataset, outperforming thestate-of-the-art by 14.1%. We also provide detailed analysis of MVDet on anewly introduced synthetic dataset, MultiviewX, which allows us to control thelevel of occlusion. Code and MultiviewX dataset are available athttps://github.com/hou-yz/MVDet.

 

Quick Read (beta)

loading the full paper ...