Abstract
Real-world problems are often multi-objective with decision-makers unable tospecify a priori which trade-off between the conflicting objectives ispreferable. Intuitively, building machine learning solutions in such caseswould entail providing multiple predictions that span and uniformly cover thePareto front of all optimal trade-off solutions. We propose a novel approachfor multi-objective training of neural networks to approximate the Pareto frontduring inference. In our approach, the neural networks are trainedmulti-objectively using a dynamic loss function, wherein each network's losses(corresponding to multiple objectives) are weighted by their hypervolumemaximizing gradients. We discuss and illustrate why training processes toapproximate Pareto fronts need to optimize on fronts of individual trainingsamples instead of on only the front of average losses. Experiments on threemulti-objective problems show that our approach returns outputs that arewell-spread across different trade-offs on the approximated Pareto frontwithout requiring the trade-off vectors to be specified a priori. Further,results of comparisons with the state-of-the-art approaches highlight the addedvalue of our proposed approach, especially in asymmetric Pareto fronts.