SignCol: Open-Source Software for Collecting Sign Language Gestures

  • 2019-10-31 19:36:18
  • Mohammad Eslami, Mahdi Karami, Sedigheh Eslami, Solale Tabarestani, Farah Torkamani-Azar, Christoph Meinel
  • 2

Abstract

Sign(ed) languages use gestures, such as hand or head movements, forcommunication. Sign language recognition is an assistive technology forindividuals with hearing disability and its goal is to improve suchindividuals' life quality by facilitating their social involvement. Since signlanguages are vastly varied in alphabets, as known as signs, a sign recognitionsoftware should be capable of handling eight different types of signcombinations, e.g. numbers, letters, words and sentences. Due to the intrinsiccomplexity and diversity of symbolic gestures, recognition algorithms need acomprehensive visual dataset to learn by. In this paper, we describe the designand implementation of a Microsoft Kinect-based open source software, calledSignCol, for capturing and saving the gestures used in sign languages. Our worksupports a multi-language database and reports the recorded items statistics.SignCol can capture and store colored(RGB) frames, depth frames, infraredframes, body index frames, coordinate mapped color-body frames, skeletoninformation of each frame and camera parameters simultaneously.

 

Quick Read (beta)

loading the full paper ...