Test-Time Training with Masked Autoencoders

  • 2022-09-15 18:59:34
  • Yossi Gandelsman, Yu Sun, Xinlei Chen, Alexei A. Efros
  • 19

Abstract

Test-time training adapts to a new test distribution on the fly by optimizinga model for each test input using self-supervision. In this paper, we usemasked autoencoders for this one-sample learning problem. Empirically, oursimple method improves generalization on many visual benchmarks fordistribution shifts. Theoretically, we characterize this improvement in termsof the bias-variance trade-off.

 

Quick Read (beta)

loading the full paper ...