Abstract
Recent progress in neural machine translation is directed towards largerneural networks trained on an increasing amount of hardware resources. As aresult, NMT models are costly to train, both financially, due to theelectricity and hardware cost, and environmentally, due to the carbonfootprint. It is especially true in transfer learning for its additional costof training the "parent" model before transferring knowledge and training thedesired "child" model. In this paper, we propose a simple method of re-using analready trained model for different language pairs where there is no need formodifications in model architecture. Our approach does not need a separateparent model for each investigated language pair, as it is typical in NMTtransfer learning. To show the applicability of our method, we recycle aTransformer model trained by different researchers and use it to seed modelsfor different language pairs. We achieve better translation quality and shorterconvergence times than when training from random initialization.