Abstract
This paper proposes a framework to improve the typing experience of mobileusers in morphologically rich languages. Smartphone keyboards typically supportfeatures such as input decoding, corrections and predictions that all rely onlanguage models. For latency reasons, these operations happen on device, so themodels are of limited size and cannot easily cover all the words needed byusers for their daily tasks, especially in morphologically rich languages. Inparticular, the compounding nature of Germanic languages makes their vocabularyvirtually infinite. Similarly, heavily inflecting and agglutinative languages(e.g. Slavic, Turkic or Finno-Ugric languages) tend to have much largervocabularies than morphologically simpler languages, such as English orMandarin. We propose to model such languages with automatically selectedsubword units annotated with what we call binding types, allowing the decoderto know when to bind subword units into words. We show that this method bringsaround 20% word error rate reduction in a variety of compounding languages.This is more than twice the improvement we previously obtained with a morebasic approach, also described in the paper.