SkeleMotion: A New Representation of Skeleton Joint Sequences Based on Motion Information for 3D Action Recognition

  • 2019-07-30 15:40:07
  • Carlos Caetano, Jessica Sena, François Brémond, Jefersson A. dos Santos, William Robson Schwartz
  • 1

Abstract

Due to the availability of large-scale skeleton datasets, 3D human actionrecognition has recently called the attention of computer vision community.Many works have focused on encoding skeleton data as skeleton imagerepresentations based on spatial structure of the skeleton joints, in which thetemporal dynamics of the sequence is encoded as variations in columns and thespatial structure of each frame is represented as rows of a matrix. To furtherimprove such representations, we introduce a novel skeleton imagerepresentation to be used as input of Convolutional Neural Networks (CNNs),named SkeleMotion. The proposed approach encodes the temporal dynamics byexplicitly computing the magnitude and orientation values of the skeletonjoints. Different temporal scales are employed to compute motion values toaggregate more temporal dynamics to the representation making it able tocapture longrange joint interactions involved in actions as well as filteringnoisy motion values. Experimental results demonstrate the effectiveness of theproposed representation on 3D action recognition outperforming thestate-of-the-art on NTU RGB+D 120 dataset.

 

Quick Read (beta)

loading the full paper ...