Abstract

Deep generative models are powerful tools that have produced impressiveresults in recent years. These advances have been for the most part empiricallydriven, making it essential that we use high quality evaluation metrics. Inthis paper, we provide new insights into the Inception Score, a recentlyproposed and widely used evaluation metric for generative models, anddemonstrate that it fails to provide useful guidance when comparing models. Wediscuss both suboptimalities of the metric itself and issues with itsapplication. Finally, we call for researchers to be more systematic and carefulwhen evaluating and comparing generative models, as the advancement of thefield depends upon it.

 

Quick Read (beta)