Abstract
We study the question: How can we select the right data for fine-tuning to aspecific task? We call this data selection problem active fine-tuning and showthat it is an instance of transductive active learning, a novel generalizationof classical active learning. We propose ITL, short for information-basedtransductive learning, an approach which samples adaptively to maximizeinformation gained about the specified task. We are the first to show, undergeneral regularity assumptions, that such decision rules converge uniformly tothe smallest possible uncertainty obtainable from the accessible data. We applyITL to the few-shot fine-tuning of large neural networks and show thatfine-tuning with ITL learns the task with significantly fewer examples than thestate-of-the-art.