GLaM-Sign: Greek Language Multimodal Lip Reading with Integrated Sign Language Accessibility

  • 2025-01-09 13:06:47
  • Dimitris Kouremenos, Klimis Ntalianis
  • 0

Abstract

The Greek Language Multimodal Lip Reading with Integrated Sign LanguageAccessibility (GLaM-Sign) [1] is a groundbreaking resource in accessibility andmultimodal AI, designed to support Deaf and Hard-of-Hearing (DHH) individuals.Developed from the FEELIT project [2], it integrates high-resolution audio,video, textual transcriptions, and Greek Sign Language translations forapplications like real-time sign language translation and enhanced subtitlesynchronization. While its primary focus is on promoting inclusivity in theGreek tourism sector, its adaptability extends to education, healthcare, andpublic services. Future advancements will enhance word-level precision andscalability to additional languages, supported by advanced AI methodologies andcollaborations with diverse stakeholders. This dataset underscores thetransformative potential of multimodal resources in bridging communicationgaps, fostering innovation, and setting a benchmark for ethical AI andinclusive technologies.

 

Quick Read (beta)

loading the full paper ...