Abstract
There are an increasing number of domains in which artificial intelligence(AI) systems both surpass human ability and accurately model human behavior.This introduces the possibility of algorithmically-informed teaching in thesedomains through more relatable AI partners and deeper insights into humandecision-making. Critical to achieving this goal, however, is coherentlymodeling human behavior at various skill levels. Chess is an ideal model systemfor conducting research into this kind of human-AI alignment, with its richhistory as a pivotal testbed for AI research, mature superhuman AI systems likeAlphaZero, and precise measurements of skill via chess rating systems. Previouswork in modeling human decision-making in chess uses completely independentmodels to capture human style at different skill levels, meaning they lackcoherence in their ability to adapt to the full spectrum of human improvementand are ultimately limited in their effectiveness as AI partners and teachingtools. In this work, we propose a unified modeling approach for human-AIalignment in chess that coherently captures human style across different skilllevels and directly captures how people improve. Recognizing the complex,non-linear nature of human learning, we introduce a skill-aware attentionmechanism to dynamically integrate players' strengths with encoded chesspositions, enabling our model to be sensitive to evolving player skill. Ourexperimental results demonstrate that this unified framework significantlyenhances the alignment between AI and human players across a diverse range ofexpertise levels, paving the way for deeper insights into human decision-makingand AI-guided teaching tools.