Embodied Question Answering

  • 2017-11-30 18:06:47
  • Abhishek Das, Samyak Datta, Georgia Gkioxari, Stefan Lee, Devi Parikh, Dhruv Batra
  • 22

Abstract

We present a new AI task -- Embodied Question Answering (EmbodiedQA) -- wherean agent is spawned at a random location in a 3D environment and asked anatural language question ("What color is the car?"). In order to answer, theagent must first intelligently navigate to explore the environment, gatherinformation through first-person (egocentric) vision, and then answer thequestion ("orange"). This challenging task requires a range of AI skills -- active perception,language understanding, goal-driven navigation, commonsense reasoning, andgrounding of language into actions. In this work, we develop the environments,end-to-end-trained reinforcement learning agents, and evaluation protocols forEmbodiedQA.

 

Introduction (beta)

None

 

Conclusion (beta)

None