NeuFlow v2: High-Efficiency Optical Flow Estimation on Edge Devices

  • 2024-08-19 18:13:34
  • Zhiyong Zhang, Aniket Gupta, Huaizu Jiang, Hanumant Singh
  • 0

Abstract

Real-time high-accuracy optical flow estimation is crucial for variousreal-world applications. While recent learning-based optical flow methods haveachieved high accuracy, they often come with significant computational costs.In this paper, we propose a highly efficient optical flow method that balanceshigh accuracy with reduced computational demands. Building upon NeuFlow v1, weintroduce new components including a much more light-weight backbone and a fastrefinement module. Both these modules help in keeping the computational demandslight while providing close to state of the art accuracy. Compares to otherstate of the art methods, our model achieves a 10x-70x speedup whilemaintaining comparable performance on both synthetic and real-world data. It iscapable of running at over 20 FPS on 512x384 resolution images on a Jetson OrinNano. The full training and evaluation code is available athttps://github.com/neufieldrobotics/NeuFlow_v2.

 

Quick Read (beta)

loading the full paper ...