Can Everybody Sign Now? Exploring Sign Language Video Generation from 2D Poses

  • 2021-01-04 14:44:33
  • Lucas Ventura, Amanda Duarte, Xavier Giro-i-Nieto
  • 0

Abstract

Recent work have addressed the generation of human poses represented by 2D/3Dcoordinates of human joints for sign language. We use the state of the art inDeep Learning for motion transfer and evaluate them on How2Sign, an AmericanSign Language dataset, to generate videos of signers performing sign languagegiven a 2D pose skeleton. We evaluate the generated videos quantitatively andqualitatively showing that the current models are not enough to generatedadequate videos for Sign Language due to lack of detail in hands.

 

Quick Read (beta)

loading the full paper ...