Abstract
We propose a novel framework to produce cartoon videos by fetching the colorinformation from two input keyframes while following the animated motion guidedby a user sketch. The key idea of the proposed approach is to estimate thedense cross-domain correspondence between the sketch and cartoon video frames,and employ a blending module with occlusion estimation to synthesize the middleframe guided by the sketch. After that, the input frames and the syntheticframe equipped with established correspondence are fed into an arbitrary-timeframe interpolation pipeline to generate and refine additional inbetweenframes. Finally, a module to preserve temporal consistency is employed.Compared to common frame interpolation methods, our approach can address frameswith relatively large motion and also has the flexibility to enable users tocontrol the generated video sequences by editing the sketch guidance. Byexplicitly considering the correspondence between frames and the sketch, we canachieve higher quality results than other image synthesis methods. Our resultsshow that our system generalizes well to different movie frames, achievingbetter results than existing solutions.