Abstract
This paper presents a study on natural language to sign language translationwith human-robot interaction application purposes. By means of the presentedmethodology, the humanoid robot TEO is expected to represent Spanish signlanguage automatically by converting text into movements, thanks to theperformance of neural networks. Natural language to sign language translationpresents several challenges to developers, such as the discordance between thelength of input and output data and the use of non-manual markers. Therefore,neural networks and, consequently, sequence-to-sequence models, are selected asa data-driven system to avoid traditional expert system approaches or temporaldependencies limitations that lead to limited or too complex translationsystems. To achieve these objectives, it is necessary to find a way to performhuman skeleton acquisition in order to collect the signing input data. OpenPoseand skeletonRetriever are proposed for this purpose and a 3D sensorspecification study is developed to select the best acquisition hardware.