milliFlow: Scene Flow Estimation on mmWave Radar Point Cloud for Human Motion Sensing

  • 2024-07-09 18:29:35
  • Fangqiang Ding, Zhen Luo, Peijun Zhao, Chris Xiaoxuan Lu
  • 0

Abstract

Human motion sensing plays a crucial role in smart systems fordecision-making, user interaction, and personalized services. Extensiveresearch that has been conducted is predominantly based on cameras, whoseintrusive nature limits their use in smart home applications. To address this,mmWave radars have gained popularity due to their privacy-friendly features. Inthis work, we propose milliFlow, a novel deep learning approach to estimatescene flow as complementary motion information for mmWave point cloud, servingas an intermediate level of features and directly benefiting downstream humanmotion sensing tasks. Experimental results demonstrate the superior performanceof our method when compared with the competing approaches. Furthermore, byincorporating scene flow information, we achieve remarkable improvements inhuman activity recognition and human parsing and support human body parttracking.

 

Quick Read (beta)

loading the full paper ...