Abstract
Exploiting a common language as an auxiliary for better translation has along tradition in machine translation and lets supervised learning-basedmachine translation enjoy the enhancement delivered by the well-used pivotlanguage in the absence of a source language to target language parallelcorpus. The rise of unsupervised neural machine translation (UNMT) almostcompletely relieves the parallel corpus curse, though UNMT is still subject tounsatisfactory performance due to the vagueness of the clues available for itscore back-translation training. Further enriching the idea of pivot translationby extending the use of parallel corpora beyond the source-target paradigm, wepropose a new reference language-based framework for UNMT, RUNMT, in which thereference language only shares a parallel corpus with the source, but thiscorpus still indicates a signal clear enough to help the reconstructiontraining of UNMT through a proposed reference agreement mechanism. Experimentalresults show that our methods improve the quality of UNMT over that of a strongbaseline that uses only one auxiliary language, demonstrating the usefulness ofthe proposed reference language-based UNMT and establishing a good start forthe community.