Abstract
Predicting the future motion of surrounding agents is essential forautonomous vehicles (AVs) to operate safely in dynamic, human-robot-mixedenvironments. Context information, such as road maps and surrounding agents'states, provides crucial geometric and semantic information for motion behaviorprediction. To this end, recent works explore two-stage prediction frameworkswhere coarse trajectories are first proposed, and then used to select criticalcontext information for trajectory refinement. However, they either incur alarge amount of computation or bring limited improvement, if not both. In thispaper, we introduce a novel scenario-adaptive refinement strategy, namedSmartRefine, to refine prediction with minimal additional computation.Specifically, SmartRefine can comprehensively adapt refinement configurationsbased on each scenario's properties, and smartly chooses the number ofrefinement iterations by introducing a quality score to measure the predictionquality and remaining refinement potential of each scenario. SmartRefine isdesigned as a generic and flexible approach that can be seamlessly integratedinto most state-of-the-art motion prediction models. Experiments on Argoverse(1 & 2) show that our method consistently improves the prediction accuracy ofmultiple state-of-the-art prediction models. Specifically, by addingSmartRefine to QCNet, we outperform all published ensemble-free works on theArgoverse 2 leaderboard (single agent track) at submission. Comprehensivestudies are also conducted to ablate design choices and explore the mechanismbehind multi-iteration refinement. Codes are available athttps://github.com/opendilab/SmartRefine/