On the Choice of Auxiliary Languages for Improved Sequence Tagging

  • 2020-05-19 12:32:20
  • Lukas Lange, Heike Adel, Jannik Strötgen
  • 0

Abstract

Recent work showed that embeddings from related languages can improve theperformance of sequence tagging, even for monolingual models. In this analysispaper, we investigate whether the best auxiliary language can be predictedbased on language distances and show that the most related language is notalways the best auxiliary language. Further, we show that attention-basedmeta-embeddings can effectively combine pre-trained embeddings from differentlanguages for sequence tagging and set new state-of-the-art results forpart-of-speech tagging in five languages.

 

Quick Read (beta)

loading the full paper ...