Abstract
Vocabulary learning is vital to foreign language learning. Correct andadequate feedback is essential to successful and satisfying vocabularytraining. However, many vocabulary and language evaluation systems perform onsimple rules and do not account for real-life user learning data. This workintroduces Multi-Language Vocabulary Evaluation Data Set (MuLVE), a data setconsisting of vocabulary cards and real-life user answers, labeled indicatingwhether the user answer is correct or incorrect. The data source is userlearning data from the Phase6 vocabulary trainer. The data set containsvocabulary questions in German and English, Spanish, and French as targetlanguage and is available in four different variations regarding pre-processingand deduplication. We experiment to fine-tune pre-trained BERT language modelson the downstream task of vocabulary evaluation with the proposed MuLVE dataset. The results provide outstanding results of > 95.5 accuracy and F2-score.The data set is available on the European Language Grid.