Abstract
Multi-task learning, in which several tasks are jointly learned by a singlemodel, allows NLP models to share information from multiple annotations and mayfacilitate better predictions when the tasks are inter-related. This technique,however, requires annotating the same text with multiple annotation schemeswhich may be costly and laborious. Active learning (AL) has been demonstratedto optimize annotation processes by iteratively selecting unlabeled exampleswhose annotation is most valuable for the NLP model. Yet, multi-task activelearning (MT-AL) has not been applied to state-of-the-art pre-trainedTransformer-based NLP models. This paper aims to close this gap. We explorevarious multi-task selection criteria in three realistic multi-task scenarios,reflecting different relations between the participating tasks, and demonstratethe effectiveness of multi-task compared to single-task selection. Our resultssuggest that MT-AL can be effectively used in order to minimize annotationefforts for multi-task NLP models.