A survey on domain adaptation theory: learning bounds and theoretical guarantees

  • 2020-06-17 11:57:24
  • Ievgen Redko, Emilie Morvant, Amaury Habrard, Marc Sebban, Younès Bennani
  • 0

Abstract

All famous machine learning algorithms that comprise both supervised andsemi-supervised learning work well only under a common assumption: the trainingand test data follow the same distribution. When the distribution changes, moststatistical models must be reconstructed from newly collected data, which forsome applications can be costly or impossible to obtain. Therefore, it hasbecome necessary to develop approaches that reduce the need and the effort toobtain new labeled samples by exploiting data that are available in relatedareas, and using these further across similar fields. This has given rise to anew machine learning framework known as transfer learning: a learning settinginspired by the capability of a human being to extrapolate knowledge acrosstasks to learn more efficiently. Despite a large amount of different transferlearning scenarios, the main objective of this survey is to provide an overviewof the state-of-the-art theoretical results in a specific, and arguably themost popular, sub-field of transfer learning, called domain adaptation. In thissub-field, the data distribution is assumed to change across the training andthe test data, while the learning task remains the same. We provide a firstup-to-date description of existing results related to domain adaptation problemthat cover learning bounds based on different statistical learning frameworks.

 

Quick Read (beta)

loading the full paper ...