Multilingual and code-switching ASR challenges for low resource Indian languages

  • 2021-04-01 03:37:01
  • Anuj Diwan, Rakesh Vaideeswaran, Sanket Shah, Ankita Singh, Srinivasa Raghavan, Shreya Khare, Vinit Unni, Saurabh Vyas, Akash Rajpuria, Chiranjeevi Yarra, Ashish Mittal, Prasanta Kumar Ghosh, Preethi Jyothi, Kalika Bali, Vivek Seshadri, Sunayana Sitaram, Samarth Bharadwaj, Jai Nanavati, Raoul Nanavati, Karthik Sankaranarayanan, Tejaswi Seeram, Basil Abraham
  • 4


Recently, there is increasing interest in multilingual automatic speechrecognition (ASR) where a speech recognition system caters to multiple lowresource languages by taking advantage of low amounts of labeled corpora inmultiple languages. With multilingualism becoming common in today's world,there has been increasing interest in code-switching ASR as well. Incode-switching, multiple languages are freely interchanged within a singlesentence or between sentences. The success of low-resource multilingual andcode-switching ASR often depends on the variety of languages in terms of theiracoustics, linguistic characteristics as well as the amount of data availableand how these are carefully considered in building the ASR system. In thischallenge, we would like to focus on building multilingual and code-switchingASR systems through two different subtasks related to a total of seven Indianlanguages, namely Hindi, Marathi, Odia, Tamil, Telugu, Gujarati and Bengali.For this purpose, we provide a total of ~600 hours of transcribed speech data,comprising train and test sets, in these languages including two code-switchedlanguage pairs, Hindi-English and Bengali-English. We also provide a baselinerecipe for both the tasks with a WER of 30.73% and 32.45% on the test sets ofmultilingual and code-switching subtasks, respectively.


Quick Read (beta)

loading the full paper ...