Abstract
Decision making in automated driving is highly specific to the environmentand thus semantic segmentation plays a key role in recognizing the objects inthe environment around the car. Pixel level classification once considered achallenging task which is now becoming mature to be productized in a car.However, semantic annotation is time consuming and quite expensive. Syntheticdatasets with domain adaptation techniques have been used to alleviate the lackof large annotated datasets. In this work, we explore an alternate approach ofleveraging the annotations of other tasks to improve semantic segmentation.Recently, multi-task learning became a popular paradigm in automated drivingwhich demonstrates joint learning of multiple tasks improves overallperformance of each tasks. Motivated by this, we use auxiliary tasks like depthestimation to improve the performance of semantic segmentation task. We proposeadaptive task loss weighting techniques to address scale issues in multi-taskloss functions which become more crucial in auxiliary tasks. We experimented onautomotive datasets including SYNTHIA and KITTI and obtained 3% and 5%improvement in accuracy respectively.