Abstract
Over the recent years, Reinforcement Learning combined with Deep Learningtechniques has successfully proven to solve complex problems in variousdomains, including robotics, self-driving cars, and finance. In this paper, weare introducing Reinforcement Learning (RL) to label placement, a complex taskin data visualization that seeks optimal positioning for labels to avoidoverlap and ensure legibility. Our novel point-feature label placement methodutilizes Multi-Agent Deep Reinforcement Learning to learn the label placementstrategy, the first machine-learning-driven labeling method, in contrast to theexisting hand-crafted algorithms designed by human experts. To facilitate RLlearning, we developed an environment where an agent acts as a proxy for alabel, a short textual annotation that augments visualization. Our results showthat the strategy trained by our method significantly outperforms the randomstrategy of an untrained agent and the compared methods designed by humanexperts in terms of completeness (i.e., the number of placed labels). Thetrade-off is increased computation time, making the proposed method slower thanthe compared methods. Nevertheless, our method is ideal for scenarios where thelabeling can be computed in advance, and completeness is essential, such ascartographic maps, technical drawings, and medical atlases. Additionally, weconducted a user study to assess the perceived performance. The outcomesrevealed that the participants considered the proposed method to besignificantly better than the other examined methods. This indicates that theimproved completeness is not just reflected in the quantitative metrics butalso in the subjective evaluation by the participants.