Abstract
Domain adversarial training has been ubiquitous for achieving invariantrepresentations and is used widely for various domain adaptation tasks. Inrecent times, methods converging to smooth optima have shown improvedgeneralization for supervised learning tasks like classification. In this work,we analyze the effect of smoothness enhancing formulations on domainadversarial training, the objective of which is a combination of task loss (eg.classification, regression, etc.) and adversarial terms. We find thatconverging to a smooth minima with respect to (w.r.t.) task loss stabilizes theadversarial training leading to better performance on target domain. Incontrast to task loss, our analysis shows that converging to smooth minimaw.r.t. adversarial loss leads to sub-optimal generalization on the targetdomain. Based on the analysis, we introduce the Smooth Domain AdversarialTraining (SDAT) procedure, which effectively enhances the performance ofexisting domain adversarial methods for both classification and objectdetection tasks. Our analysis also provides insight into the extensive usage ofSGD over Adam in the community for domain adversarial training.