Abstract
Recently, there has been an increasing interest in unsupervised parsers thatoptimize semantically oriented objectives, typically using reinforcementlearning. Unfortunately, the learned trees often do not match actual syntaxtrees well. Shen et al. (2018) propose a structured attention mechanism forlanguage modeling (PRPN), which induces better syntactic structures but relieson ad hoc heuristics. Also, their model lacks interpretability as it is notgrounded in parsing actions. In our work, we propose an imitation learningapproach to unsupervised parsing, where we transfer the syntactic knowledgeinduced by the PRPN to a Tree-LSTM model with discrete parsing actions. Itspolicy is then refined by Gumbel-Softmax training towards a semanticallyoriented objective. We evaluate our approach on the All Natural LanguageInference dataset and show that it achieves a new state of the art in terms ofparsing $F$-score, outperforming our base models, including the PRPN.