Abstract
Deep neural network models for Chinese zero pronoun resolution learn semanticinformation for zero pronoun and candidate antecedents, but tend to beshort-sighted---they often make local decisions. They typically predictcoreference chains between the zero pronoun and one single candidate antecedentone link at a time, while overlooking their long-term influence on futuredecisions. Ideally, modeling useful information of preceding potentialantecedents is critical when later predicting zero pronoun-candidate antecedentpairs. In this study, we show how to integrate local and global decision-makingby exploiting deep reinforcement learning models. With the help of thereinforcement learning agent, our model learns the policy of selectingantecedents in a sequential manner, where useful information provided byearlier predicted antecedents could be utilized for making later coreferencedecisions. Experimental results on OntoNotes 5.0 dataset show that ourtechnique surpasses the state-of-the-art models.