Abstract
We present UniFluid, a unified autoregressive framework for joint visualgeneration and understanding leveraging continuous visual tokens. Our unifiedautoregressive architecture processes multimodal image and text inputs,generating discrete tokens for text and continuous tokens for image. We findthough there is an inherent trade-off between the image generation andunderstanding task, a carefully tuned training recipe enables them to improveeach other. By selecting an appropriate loss balance weight, the unified modelachieves results comparable to or exceeding those of single-task baselines onboth tasks. Furthermore, we demonstrate that employing stronger pre-trainedLLMs and random-order generation during training is important to achievehigh-fidelity image generation within this unified framework. Built upon theGemma model series, UniFluid exhibits competitive performance across both imagegeneration and understanding, demonstrating strong transferability to variousdownstream tasks, including image editing for generation, as well as visualcaptioning and question answering for understanding.