Stanza: A Python Natural Language Processing Toolkit for Many Human Languages

  • 2020-03-16 09:05:53
  • Peng Qi, Yuhao Zhang, Yuhui Zhang, Jason Bolton, Christopher D. Manning
  • 28

Abstract

We introduce Stanza, an open-source Python natural language processingtoolkit supporting 66 human languages. Compared to existing widely usedtoolkits, Stanza features a language-agnostic fully neural pipeline for textanalysis, including tokenization, multi-word token expansion, lemmatization,part-of-speech and morphological feature tagging, dependency parsing, and namedentity recognition. We have trained Stanza on a total of 112 datasets,including the Universal Dependencies treebanks and other multilingual corpora,and show that the same neural architecture generalizes well and achievescompetitive performance on all languages tested. Additionally, Stanza includesa native Python interface to the widely used Java Stanford CoreNLP software,which further extends its functionalities to cover other tasks such ascoreference resolution and relation extraction. Source code, documentation, andpretrained models for 66 languages are available athttps://stanfordnlp.github.io/stanza.

 

Quick Read (beta)

loading the full paper ...