Modeling Global Body Configurations in American Sign Language

  • 2020-09-03 06:20:10
  • Nicholas Wilkins, Beck Cordes Galbraith, Ifeoma Nwogu
  • 9


American Sign Language (ASL) is the fourth most commonly used language in theUnited States and is the language most commonly used by Deaf people in theUnited States and the English-speaking regions of Canada. Unfortunately, untilrecently, ASL received little research. This is due, in part, to its delayedrecognition as a language until William C. Stokoe's publication in 1960.Limited data has been a long-standing obstacle to ASL research andcomputational modeling. The lack of large-scale datasets has prohibited manymodern machine-learning techniques, such as Neural Machine Translation, frombeing applied to ASL. In addition, the modality required to capture signlanguage (i.e. video) is complex in natural settings (as one must deal withbackground noise, motion blur, and the curse of dimensionality). Finally, whencompared with spoken languages, such as English, there has been limitedresearch conducted into the linguistics of ASL. We realize a simplified version of Liddell and Johnson's Movement-Hold (MH)Model using a Probabilistic Graphical Model (PGM). We trained our model onASLing, a dataset collected from three fluent ASL signers. We evaluate our PGMagainst other models to determine its ability to model ASL. Finally, weinterpret various aspects of the PGM and draw conclusions about ASL phonetics.The main contributions of this paper are


Quick Read (beta)

loading the full paper ...