Joint Flow: Temporal Flow Fields for Multi Person Tracking

  • 2018-05-11 21:27:08
  • Andreas Doering, Umar Iqbal, Juergen Gall
  • 21

Abstract

In this work we propose an online multi person pose tracker which works ontwo consecutive frames $I_{t-1}$ and $I_t$. The general formulation of ourtemporal network allows to rely on any multi person pose estimation network asspatial network. From the spatial network we extract image features and posefeatures for both frames. These features compose as input for our temporalmodel that predicts Temporal Flow Fields (TFF). These TFF are vector fieldswhich indicate the direction in which body joint is going to move from frame$I_{t-1}$ to frame $I_t$. This novel representation allows to formulate asimilarity measure of detected joints. These similarities are used as binarypotentials in an bipartite graph optimization problem in order to performtracking of multiple poses. We show that these TFF can be learned by a relativesmall CNN network whilst achieving state-of-the-art multi person pose trackingresults.

 

Quick Read (beta)

loading the full paper ...