Social NCE: Contrastive Learning of Socially-aware Motion Representations

  • 2021-04-15 17:54:33
  • Yuejiang Liu, Qi Yan, Alexandre Alahi
  • 0

Abstract

Learning socially-aware motion representations is at the core of recentadvances in human trajectory forecasting and robot navigation in crowdedspaces. Despite promising progress, existing neural motion models oftenstruggle to generalize in closed-loop operations (e.g., output collidingtrajectories), when the training set lacks examples collected from dangerousscenarios. In this work, we propose to address this issue via contrastivelearning with negative data augmentation. Concretely, we introduce a socialcontrastive loss that encourages the encoded motion representation to preservesufficient information for distinguishing a positive future event from a set ofnegative ones. We explicitly draw these negative samples based on our domainknowledge of unfavorable circumstances in the multi-agent context. Experimentalresults show that the proposed method dramatically reduces the collision ratesof recent trajectory forecasting, behavioral cloning and reinforcement learningalgorithms, outperforming current state-of-the-art models on severalbenchmarks. Our method makes few assumptions about neural architecture designs,and hence can be used as a generic way to promote the robustness of neuralmotion models.

 

Quick Read (beta)

loading the full paper ...