Abstract

This paper describes Oregon State University's submissions to the sharedWMT'17 task "multimodal translation task I". In this task, all the sentencepairs are image captions in different languages. The key difference betweenthis task and conventional machine translation is that we have correspondingimages as additional information for each sentence pair. In this paper, weintroduce a simple but effective system which takes an image shared betweendifferent languages, feeding it into the both encoding and decoding side. Wereport our system's performance for English-French and English-German withFlickr30K (in-domain) and MSCOCO (out-of-domain) datasets. Our system achievesthe best performance in TER for English-German for MSCOCO dataset.

 

Quick Read (beta)