Abstract
Equalized odds, as a popular notion of algorithmic fairness, aims to ensurethat sensitive variables, such as race and gender, do not unfairly influencethe algorithm prediction when conditioning on the true outcome. Despite rapidadvancements, most of the current research focuses on the violation ofequalized odds caused by one sensitive attribute, leaving the challenge ofsimultaneously accounting for multiple attributes under-addressed. We addressthis gap by introducing a fairness learning approach that integratesadversarial learning with a novel inverse conditional permutation. Thisapproach effectively and flexibly handles multiple sensitive attributes,potentially of mixed data types. The efficacy and flexibility of our method aredemonstrated through both simulation studies and empirical analysis ofreal-world datasets.