Abstract
Real-world systems often involve some pool of users choosing between a set ofservices. With the increase in popularity of online learning algorithms, theseservices can now self-optimize, leveraging data collected on users to maximizesome reward such as service quality. On the flipside, users may strategicallychoose which services to use in order to pursue their own reward functions, inthe process wielding power over which services can see and use their data.Extensive prior research has been conducted on the effects of strategic usersin single-service settings, with strategic behavior manifesting in themanipulation of observable features to achieve a desired classification;however, this can often be costly or unattainable for users and fails tocapture the full behavior of multi-service dynamic systems. As such, we analyzea setting in which strategic users choose among several available services inorder to pursue positive classifications, while services seek to minimize lossfunctions on their observations. We focus our analysis on realizable settings,and show that naive retraining can still lead to oscillation even if all usersare observed at different times; however, if this retraining uses memory ofpast observations, convergent behavior can be guaranteed for certain lossfunction classes. We provide results obtained from synthetic and real-worlddata to empirically validate our theoretical findings.