Training Classifiers with Natural Language Explanations

  • 2018-05-10 04:59:59
  • Braden Hancock, Paroma Varma, Stephanie Wang, Martin Bringmann, Percy Liang, Christopher RĂ©
  • 30

Abstract

Training accurate classifiers requires many labels, but each label providesonly limited information (one bit for binary classification). In this work, wepropose BabbleLabble, a framework for training classifiers in which anannotator provides a natural language explanation for each labeling decision. Asemantic parser converts these explanations into programmatic labelingfunctions that generate noisy labels for an arbitrary amount of unlabeled data,which is used to train a classifier. On three relation extraction tasks, wefind that users are able to train classifiers with comparable F1 scores from5-100 faster by providing explanations instead of just labels. Furthermore,given the inherent imperfection of labeling functions, we find that a simplerule-based semantic parser suffices.

 

Introduction (beta)

None

 

Conclusion (beta)

None