Abstract
Layout generation is a critical step in graphic design to achieve meaningfulcompositions of elements. Most previous works view it as a sequence generationproblem by concatenating element attribute tokens (i.e., category, size,position). So far the autoregressive approach (AR) has achieved promisingresults, but is still limited in global context modeling and suffers from errorpropagation since it can only attend to the previously generated tokens. Recentnon-autoregressive attempts (NAR) have shown competitive results, whichprovides a wider context range and the flexibility to refine with iterativedecoding. However, current works only use simple heuristics to recognizeerroneous tokens for refinement which is inaccurate. This paper first conductsan in-depth analysis to better understand the difference between the AR and NARframework. Furthermore, based on our observation that pixel space is moresensitive in capturing spatial patterns of graphic layouts (e.g., overlap,alignment), we propose a learning-based locator to detect erroneous tokenswhich takes the wireframe image rendered from the generated layout sequence asinput. We show that it serves as a complementary modality to the elementsequence in object space and contributes greatly to the overall performance.Experiments on two public datasets show that our approach outperforms both ARand NAR baselines. Extensive studies further prove the effectiveness ofdifferent modules with interesting findings. Our code will be available athttps://github.com/ffffatgoose/SpotError.