YOLO3D: End-to-end real-time 3D Oriented Object Bounding Box Detection from LiDAR Point Cloud

  • 2018-08-07 13:19:24
  • Waleed Ali, Sherif Abdelkarim, Mohamed Zahran, Mahmoud Zidan, Ahmad El Sallab
  • 17


Object detection and classification in 3D is a key task in Automated Driving(AD). LiDAR sensors are employed to provide the 3D point cloud reconstructionof the surrounding environment, while the task of 3D object bounding boxdetection in real time remains a strong algorithmic challenge. In this paper,we build on the success of the one-shot regression meta-architecture in the 2Dperspective image space and extend it to generate oriented 3D object boundingboxes from LiDAR point cloud. Our main contribution is in extending the lossfunction of YOLO v2 to include the yaw angle, the 3D box center in Cartesiancoordinates and the height of the box as a direct regression problem. Thisformulation enables real-time performance, which is essential for automateddriving. Our results are showing promising figures on KITTI benchmark,achieving real-time performance (40 fps) on Titan X GPU.


Introduction (beta)



Conclusion (beta)