Abstract
The success of many natural language processing (NLP) tasks is bound by thenumber and quality of annotated data, but there is often a shortage of suchtraining data. In this paper, we ask the question: "Can we combine a neuralnetwork (NN) with regular expressions (RE) to improve supervised learning forNLP?". In answer, we develop novel methods to exploit the rich expressivenessof REs at different levels within a NN, showing that the combinationsignificantly enhances the learning effectiveness when a small number oftraining examples are available. We evaluate our approach by applying it tospoken language understanding for intent detection and slot filling.Experimental results show that our approach is highly effective in exploitingthe available training data, giving a clear boost to the RE-unaware NN.