Abstract

We present the MASSIVE dataset--Multilingual Amazon Slu resource package(SLURP) for Slot-filling, Intent classification, and Virtual assistantEvaluation. MASSIVE contains 1M realistic, parallel, labeled virtual assistantutterances spanning 51 languages, 18 domains, 60 intents, and 55 slots. MASSIVEwas created by tasking professional translators to localize the English-onlySLURP dataset into 50 typologically diverse languages from 29 genera. We alsopresent modeling results on XLM-R and mT5, including exact match accuracy,intent classification accuracy, and slot-filling F1 score. We have released ourdataset, modeling code, and models publicly.

 

Quick Read (beta)