Abstract
We have come up with a research that hopes to provide a bridge between theusers of American Sign Language and the users of spoken language and IndianSign Language (ISL). The research enabled us to create a novel framework thatwe have developed for Learner Systems. Leveraging art of Large models to createkey features including: - Real-time translation between these two signlanguages in an efficient manner. Making LLM's capability available forseamless translations to ISL. Here is the full study showing its implementationin this paper. The core of the system is a sophisticated pipeline that beginswith reclassification and recognition of ASL gestures based on a strong RandomForest Classifier. By recognizing the ASL, it is translated into text which canbe more easily processed. Highly evolved natural language NLP (Natural LanguageProcessing) techniques come in handy as they play a role in our LLM integrationwhere you then use LLMs to be able to convert the ASL text to ISL whichprovides you with the intent of sentence or phrase. The final step is tosynthesize the translated text back into ISL gestures, creating an end-to-endtranslation experience using RIFE-Net. This framework is tasked with keychallenges such as automatically dealing with gesture variability andovercoming the linguistic differences between ASL and ISL. By automating thetranslation process, we hope to vastly improve accessibility for sign languageusers. No longer will the communication gap between ASL and ISL createbarriers; this totally cool innovation aims to bring our communities closertogether. And we believe, with full confidence in our framework, that we'reable to apply the same principles across a wide variety of sign languagedialects.