Abstract
We propose a novel generative video model to robustly learn temporal changeas a neural Ordinary Differential Equation (ODE) flow with a bilinear objectivewhich combines two aspects: The first is to map from the past into future videoframes directly. Previous work has mapped the noise to new frames, a morecomputationally expensive process. Unfortunately, starting from the previousframe, instead of noise, is more prone to drifting errors. Hence, second, weadditionally learn how to remove the accumulated errors as the joint objectiveby adding noise during training. We demonstrate unconditional video generationin a streaming manner for various video datasets, all at competitive qualitycompared to a conditional diffusion baseline but with higher speed, i.e., fewerODE solver steps.