Abstract
We introduce MusicInfuser, an approach for generating high-quality dancevideos that are synchronized to a specified music track. Rather than attemptingto design and train a new multimodal audio-video model, we show how existingvideo diffusion models can be adapted to align with musical inputs byintroducing lightweight music-video cross-attention and a low-rank adapter.Unlike prior work requiring motion capture data, our approach fine-tunes onlyon dance videos. MusicInfuser achieves high-quality music-driven videogeneration while preserving the flexibility and generative capabilities of theunderlying models. We introduce an evaluation framework using Video-LLMs toassess multiple dimensions of dance generation quality. The project page andcode are available at https://susunghong.github.io/MusicInfuser.