Abstract
In this work, we propose DiT360, a DiT-based framework that performs hybridtraining on perspective and panoramic data for panoramic image generation. Forthe issues of maintaining geometric fidelity and photorealism in generationquality, we attribute the main reason to the lack of large-scale, high-quality,real-world panoramic data, where such a data-centric view differs from priormethods that focus on model design. Basically, DiT360 has several key modulesfor inter-domain transformation and intra-domain augmentation, applied at boththe pre-VAE image level and the post-VAE token level. At the image level, weincorporate cross-domain knowledge through perspective image guidance andpanoramic refinement, which enhance perceptual quality while regularizingdiversity and photorealism. At the token level, hybrid supervision is appliedacross multiple modules, which include circular padding for boundarycontinuity, yaw loss for rotational robustness, and cube loss for distortionawareness. Extensive experiments on text-to-panorama, inpainting, andoutpainting tasks demonstrate that our method achieves better boundaryconsistency and image fidelity across eleven quantitative metrics. Our code isavailable at https://github.com/Insta360-Research-Team/DiT360.