Real-time On-Demand Crowd-powered Entity Extraction

  • 2017-12-06 17:12:12
  • Ting-Hao 'Kenneth' Huang, Yun-Nung Chen, Jeffrey P. Bigham
  • 0


Output-agreement mechanisms such as ESP Game have been widely used in humancomputation to obtain reliable human-generated labels. In this paper, we arguethat a "time-limited" output-agreement mechanism can be used to create a fastand robust crowd-powered component in interactive systems, particularlydialogue systems, to extract key information from user utterances on the fly.Our experiments on Amazon Mechanical Turk using the Airline Travel InformationSystem (ATIS) dataset showed that the proposed approach achieves high-qualityresults with an average response time shorter than 9 seconds.


Introduction (beta)



Conclusion (beta)