Abstract
The remarkable success of Large Language Models (LLMs) has extended to themultimodal domain, achieving outstanding performance in image understanding andgeneration. Recent efforts to develop unified Multimodal Large Language Models(MLLMs) that integrate these capabilities have shown promising results.However, existing approaches often involve complex designs in modelarchitecture or training pipeline, increasing the difficulty of model trainingand scaling. In this paper, we propose SynerGen-VL, a simple yet powerfulencoder-free MLLM capable of both image understanding and generation. Toaddress challenges identified in existing encoder-free unified MLLMs, weintroduce the token folding mechanism and the vision-expert-based progressivealignment pretraining strategy, which effectively support high-resolution imageunderstanding while reducing training complexity. After being trained onlarge-scale mixed image-text data with a unified next-token predictionobjective, SynerGen-VL achieves or surpasses the performance of existingencoder-free unified MLLMs with comparable or smaller parameter sizes, andnarrows the gap with task-specific state-of-the-art models, highlighting apromising path toward future unified MLLMs. Our code and models shall bereleased.