Abstract
The task of answering a question given a text passage has shown greatdevelopments on model performance thanks to community efforts in buildinguseful datasets. Recently, there have been doubts whether such rapid progresshas been based on truly understanding language. The same question has not beenasked in the table question answering (TableQA) task, where we are tasked toanswer a query given a table. We show that existing efforts, of using "answers"for both evaluation and supervision for TableQA, show deterioratingperformances in adversarial settings of perturbations that do not affect theanswer. This insight naturally motivates to develop new models that understandquestion and table more precisely. For this goal, we propose Neural Operator(NeOp), a multi-layer sequential network with attention supervision to answerthe query given a table. NeOp uses multiple Selective Recurrent Units (SelRUs)to further help the interpretability of the answers of the model. Experimentsshow that the use of operand information to train the model significantlyimproves the performance and interpretability of TableQA models. NeOpoutperforms all the previous models by a big margin.