Abstract
An emerging field of AI, namely Fair Machine Learning (ML), aims to quantifydifferent types of bias (also known as unfairness) exhibited in the predictionsof ML algorithms, and to design new algorithms to mitigate them. Often, thedefinitions of bias used in the literature are observational, i.e. they use theinput and output of a pre-trained algorithm to quantify a bias under concern.In reality,these definitions are often conflicting in nature and can only bedeployed if either the ground truth is known or only in retrospect afterdeploying the algorithm. Thus,there is a gap between what we want Fair ML toachieve and what it does in a dynamic social environment. Hence, we propose analternative dynamic mechanism,"Fair Game",to assure fairness in the predictionsof an ML algorithm and to adapt its predictions as the society interacts withthe algorithm over time. "Fair Game" puts together an Auditor and a Debiasingalgorithm in a loop around an ML algorithm. The "Fair Game" puts these twocomponents in a loop by leveraging Reinforcement Learning (RL). RL algorithmsinteract with an environment to take decisions, which yields new observations(also known as data/feedback) from the environment and in turn, adapts futuredecisions. RL is already used in algorithms with pre-fixed long-term fairnessgoals. "Fair Game" provides a unique framework where the fairness goals can beadapted over time by only modifying the auditor and the different biases itquantifies. Thus,"Fair Game" aims to simulate the evolution of ethical andlegal frameworks in the society by creating an auditor which sends feedback toa debiasing algorithm deployed around an ML system. This allows us to develop aflexible and adaptive-over-time framework to build Fair ML systems pre- andpost-deployment.