Abstract
Temporal distribution shifts pose a key challenge for machine learning modelstrained and deployed in dynamically evolving environments. This paperintroduces RIDER (RIsk minimization under Dynamically Evolving Regimes) whichderives optimally-weighted empirical risk minimization procedures undertemporal distribution shifts. Our approach is theoretically grounded in therandom distribution shift model, where random shifts arise as a superpositionof numerous unpredictable changes in the data-generating process. We show thatcommon weighting schemes, such as pooling all data, exponentially weightingdata, and using only the most recent data, emerge naturally as special cases inour framework. We demonstrate that RIDER consistently improves out-of-samplepredictive performance when applied as a fine-tuning step on the Yearbookdataset, across a range of benchmark methods in Wild-Time. Moreover, we showthat RIDER outperforms standard weighting strategies in two other real-worldtasks: predicting stock market volatility and forecasting ride durations in NYCtaxi data.