Abstract
This study introduces a novel method for revealing human internal attentionpatterns from gameplay data alone, leveraging offline attention techniques fromreinforcement learning (RL). We propose contextualized, task-relevant (CTR)attention networks, which generate attention maps from both human and RL agentgameplay in Atari environments. To evaluate whether the human CTR maps revealinternal attention, we validate our model by quantitative and qualitativecomparison to the agent maps as well as to a temporally integrated overtattention (TIOA) model based on human eye-tracking data. Our results show thathuman CTR maps are more sparse than the agent ones and align better with theTIOA maps. Following a qualitative visual comparison we conclude that theylikely capture patterns of internal attention. As a further application, we usethese maps to guide RL agents, finding that human internal attention-guidedagents achieve slightly improved and more stable learning compared tobaselines. This work advances the understanding of human-agent attentiondifferences and provides a new approach for extracting and validating internalattention from behavioral data.