Abstract
Rather than refining individual candidate solutions for a general non-convexoptimization problem, by analogy to evolution, we consider minimizing theaverage loss for a parametric distribution over hypotheses. In this setting, weprove that Fisher-Rao natural gradient descent (FR-NGD) optimally approximatesthe continuous-time replicator equation (an essential model of evolutionarydynamics) by minimizing the mean-squared error for the relative fitness ofcompeting hypotheses. We term this finding "conjugate natural selection" anddemonstrate its utility by numerically solving an example non-convexoptimization problem over a continuous strategy space. Next, by developingknown connections between discrete-time replicator dynamics and Bayes's rule,we show that when absolute fitness corresponds to the negative KL-divergence ofa hypothesis's predictions from actual observations, FR-NGD provides theoptimal approximation of continuous Bayesian inference. We use this result todemonstrate a novel method for estimating the parameters of stochasticprocesses.