VizWiz Grand Challenge: Answering Visual Questions from Blind People

  • 2018-02-22 18:16:53
  • Danna Gurari, Qing Li, Abigale J. Stangl, Anhong Guo, Chi Lin, Kristen Grauman, Jiebo Luo, Jeffrey P. Bigham
  • 42

Abstract

The study of algorithms to automatically answer visual questions currently ismotivated by visual question answering (VQA) datasets constructed in artificialVQA settings. We propose VizWiz, the first goal-oriented VQA dataset arisingfrom a natural VQA setting. VizWiz consists of over 31,000 visual questionsoriginating from blind people who each took a picture using a mobile phone andrecorded a spoken question about it, together with 10 crowdsourced answers pervisual question. VizWiz differs from the many existing VQA datasets because (1)images are captured by blind photographers and so are often poor quality, (2)questions are spoken and so are more conversational, and (3) often visualquestions cannot be answered. Evaluation of modern algorithms for answeringvisual questions and deciding if a visual question is answerable reveals thatVizWiz is a challenging dataset. We introduce this dataset to encourage alarger community to develop more generalized algorithms that can assist blindpeople.

 

Quick Read (beta)

loading the full paper ...