BlazePose GHUM Holistic: Real-time 3D Human Landmarks and Pose Estimation

  • 2022-06-23 14:09:58
  • Ivan Grishchenko, Valentin Bazarevsky, Andrei Zanfir, Eduard Gabriel Bazavan, Mihai Zanfir, Richard Yee, Karthik Raveendran, Matsvei Zhdanovich, Matthias Grundmann, Cristian Sminchisescu
  • 27

Abstract

We present BlazePose GHUM Holistic, a lightweight neural network pipeline for3D human body landmarks and pose estimation, specifically tailored to real-timeon-device inference. BlazePose GHUM Holistic enables motion capture from asingle RGB image including avatar control, fitness tracking and AR/VR effects.Our main contributions include i) a novel method for 3D ground truth dataacquisition, ii) updated 3D body tracking with additional hand landmarks andiii) full body pose estimation from a monocular image.

 

Quick Read (beta)

loading the full paper ...