Abstract
Democratizing access to natural language processing (NLP) technology iscrucial, especially for underrepresented and extremely low-resource languages.Previous research has focused on developing labeled and unlabeled corpora forthese languages through online scraping and document translation. While thesemethods have proven effective and cost-efficient, we have identifiedlimitations in the resulting corpora, including a lack of lexical diversity andcultural relevance to local communities. To address this gap, we conduct a casestudy on Indonesian local languages. We compare the effectiveness of onlinescraping, human translation, and paragraph writing by native speakers inconstructing datasets. Our findings demonstrate that datasets generated throughparagraph writing by native speakers exhibit superior quality in terms oflexical diversity and cultural content. In addition, we present the\datasetname{} benchmark, encompassing 12 underrepresented and extremelylow-resource languages spoken by millions of individuals in Indonesia. Ourempirical experiment results using existing multilingual large language modelsconclude the need to extend these models to more underrepresented languages. Werelease the NusaWrites dataset at https://github.com/IndoNLP/nusa-writes.