Abstract
We introduce Teacher2Task, a novel framework for multi-teacher learning thateliminates the need for manual aggregation heuristics. Existing multi-teachermethods typically rely on such heuristics to combine predictions from multipleteachers, often resulting in sub-optimal aggregated labels and the propagationof aggregation errors. Teacher2Task addresses these limitations by introducingteacher-specific input tokens and reformulating the training process. Insteadof relying on aggregated labels, the framework transforms the training data,consisting of ground truth labels and annotations from N teachers, into N+1distinct tasks: N auxiliary tasks that predict the labeling styles of the Nindividual teachers, and one primary task that focuses on the ground truthlabels. This approach, drawing upon principles from multiple learningparadigms, demonstrates strong empirical results across a range ofarchitectures, modalities, and tasks.