Abstract
Predicting the motion of a mobile agent from a third-person perspective is animportant component for many robotics applications, such as autonomousnavigation and tracking. With accurate motion prediction of other agents,robots can plan for more intelligent behaviors to achieve specified objectives,instead of acting in a purely reactive way. Previous work addresses motionprediction by either only filtering kinematics, or using hand-designed andlearned representations of the environment. Instead of separating kinematic andenvironmental context, we propose a novel approach to integrate both into aninverse reinforcement learning (IRL) framework for trajectory prediction.Instead of exponentially increasing the state-space complexity with kinematics,we propose a two-stage neural network architecture that considers motion andenvironment together to recover the reward function. The first-stage networklearns feature representations of the environment using low-level LiDARstatistics and the second-stage network combines those learned features withkinematics data. We collected over 30 km of off-road driving data and validatedexperimentally that our method can effectively extract useful environmental andkinematic features. We generate accurate predictions of the distribution offuture trajectories of the vehicle, encoding complex behaviors such asmulti-modal distributions at road intersections, and even show differentpredictions at the same intersection depending on the vehicle's speed.