Everything Is All It Takes: A Multipronged Strategy for Zero-Shot Cross-Lingual Information Extraction

  • 2021-09-14 16:21:14
  • Mahsa Yarmohammadi, Shijie Wu, Marc Marone, Haoran Xu, Seth Ebner, Guanghui Qin, Yunmo Chen, Jialiang Guo, Craig Harman, Kenton Murray, Aaron Steven White, Mark Dredze, Benjamin Van Durme
  • 2


Zero-shot cross-lingual information extraction (IE) describes theconstruction of an IE model for some target language, given existingannotations exclusively in some other language, typically English. While theadvance of pretrained multilingual encoders suggests an easy optimism of "trainon English, run on any language", we find through a thorough exploration andextension of techniques that a combination of approaches, both new and old,leads to better performance than any one cross-lingual strategy in particular.We explore techniques including data projection and self-training, and howdifferent pretrained encoders impact them. We use English-to-Arabic IE as ourinitial example, demonstrating strong performance in this setting for eventextraction, named entity recognition, part-of-speech tagging, and dependencyparsing. We then apply data projection and self-training to three tasks acrosseight target languages. Because no single set of techniques performs the bestacross all tasks, we encourage practitioners to explore various configurationsof the techniques described in this work when seeking to improve on zero-shottraining.


Quick Read (beta)

loading the full paper ...