Abstract
Stereo matching algorithms usually consist of four steps, including matchingcost calculation, matching cost aggregation, disparity calculation, anddisparity refinement. Existing CNN-based methods only adopt CNN to solve partsof the four steps, or use different networks to deal with different steps,making them difficult to obtain the overall optimal solution. In this paper, wepropose a network architecture to incorporate all steps of stereo matching. Thenetwork consists of three parts. The first part calculates the multi-scaleshared features. The second part performs matching cost calculation, matchingcost aggregation and disparity calculation to estimate the initial disparityusing shared features. The initial disparity and the shared features are usedto calculate the feature constancy that measures correctness of thecorrespondence between two input images. The initial disparity and the featureconstancy are then fed to a sub-network to refine the initial disparity. Theproposed method has been evaluated on the Scene Flow and KITTI datasets. Itachieves the state-of-the-art performance on the KITTI 2012 and KITTI 2015benchmarks while maintaining a very fast running time.