MatAnyone: Stable Video Matting with Consistent Memory Propagation

  • 2025-01-24 17:56:24
  • Peiqing Yang, Shangchen Zhou, Jixin Zhao, Qingyi Tao, Chen Change Loy
  • 0

Abstract

Auxiliary-free human video matting methods, which rely solely on inputframes, often struggle with complex or ambiguous backgrounds. To address this,we propose MatAnyone, a robust framework tailored for target-assigned videomatting. Specifically, building on a memory-based paradigm, we introduce aconsistent memory propagation module via region-adaptive memory fusion, whichadaptively integrates memory from the previous frame. This ensures semanticstability in core regions while preserving fine-grained details along objectboundaries. For robust training, we present a larger, high-quality, and diversedataset for video matting. Additionally, we incorporate a novel trainingstrategy that efficiently leverages large-scale segmentation data, boostingmatting stability. With this new network design, dataset, and trainingstrategy, MatAnyone delivers robust and accurate video matting results indiverse real-world scenarios, outperforming existing methods.

 

Quick Read (beta)

loading the full paper ...