Abstract

Making predictions in an unseen environment given data from multiple trainingenvironments is a challenging task. We approach this problem from an invarianceperspective, focusing on binary classification to shed light on generalnonlinear data generation mechanisms. We identify a unique form of invariancethat exists solely in a binary setting that allows us to train models invariantover environments. We provide sufficient conditions for such invariance andshow it is robust even when environmental conditions vary greatly. Ourformulation admits a causal interpretation, allowing us to compare it withvarious frameworks. Finally, we propose a heuristic prediction method andconduct experiments using real and synthetic datasets.

 

Quick Read (beta)