Towards Real-time and Light-weight Line Segment Detection

  • 2021-06-01 02:28:08
  • Geonmo Gu, Byungsoo Ko, SeoungHyun Go, Sung-Hyun Lee, Jingeun Lee, Minchul Shin
  • 104

Abstract

Previous deep learning-based line segment detection (LSD) suffer from theimmense model size and high computational cost for line prediction. Thisconstrains them from real-time inference on computationally restrictedenvironments. In this paper, we propose a real-time and light-weight linesegment detector for resource-constrained environments named Mobile LSD(M-LSD). We design an extremely efficient LSD architecture by minimizing thebackbone network and removing the typical multi-module process for lineprediction in previous methods. To maintain competitive performance with such alight-weight network, we present novel training schemes: Segments of Linesegment (SoL) augmentation and geometric learning scheme. SoL augmentationsplits a line segment into multiple subparts, which are used to provideauxiliary line data during the training process. Moreover, the geometriclearning scheme allows a model to capture additional geometry cues frommatching loss, junction and line segmentation, length and degree regression.Compared with TP-LSD-Lite, previously the best real-time LSD method, our model(M-LSD-tiny) achieves competitive performance with 2.5% of model size and anincrease of 130.5% in inference speed on GPU when evaluated with Wireframe andYorkUrban datasets. Furthermore, our model runs at 56.8 FPS and 48.6 FPS onAndroid and iPhone mobile devices, respectively. To the best of our knowledge,this is the first real-time deep LSD method available on mobile devices.

 

Quick Read (beta)

loading the full paper ...