Abstract
Concept Drift has been extensively studied within the context of StreamLearning. However, it is often assumed that the deployed model's predictionsplay no role in the concept drift the system experiences. Closer inspectionreveals that this is not always the case. Automated trading might be prone toself-fulfilling feedback loops. Likewise, malicious entities might adapt toevade detectors in the adversarial setting resulting in a self-negatingfeedback loop that requires the deployed models to constantly retrain. Suchsettings where a model may induce concept drift are called performative. Inthis work, we investigate this phenomenon. Our contributions are as follows:First, we define performative drift within a stream learning setting anddistinguish it from other causes of drift. We introduce a novel type of driftdetection task, aimed at identifying potential performative concept drift indata streams. We propose a first such performative drift detection approach,called CheckerBoard Performative Drift Detection (CB-PDD). We apply CB-PDD toboth synthetic and semi-synthetic datasets that exhibit varying degrees ofself-fulfilling feedback loops. Results are positive with CB-PDD showing highefficacy, low false detection rates, resilience to intrinsic drift,comparability to other drift detection techniques, and an ability toeffectively detect performative drift in semi-synthetic datasets. Secondly, wehighlight the role intrinsic (traditional) drift plays in obfuscatingperformative drift and discuss the implications of these findings as well asthe limitations of CB-PDD.