Strategies for Language Identification in Code-Mixed Low Resource Languages

  • 2018-10-16 17:35:31
  • Soumil Mandal, Sankalp Sanand
  • 11

Abstract

In the recent years, substantial work has been done on language tagging ofcode-mixed data, but most of them use large amounts of data to build theirmodels. In this article, we present three strategies for building a word levellanguage tagger for code-mixed data using very low resources. Each of themsecured an accuracy higher than our baseline model, and the best performingsystem got an accuracy around 91%. Combining all, the ensemble system achievedan accuracy around 92.6%.

 

Quick Read (beta)

loading the full paper ...