Abstract
One of the most fundamental questions in quantitative finance is theexistence of continuous-time diffusion models that fit market prices of a givenset of options. Traditionally, one employs a mix of intuition, theoretical andempirical analysis to find models that achieve exact or approximate fits. Ourcontribution is to show how a suitable game theoretical formulation of thisproblem can help solve this question by leveraging existing developments inmodern deep multi-agent reinforcement learning to search in the space ofstochastic processes. More importantly, we hope that our techniques can beleveraged and extended by the community to solve important problems in thatfield, such as the joint SPX-VIX calibration problem. Our experiments show thatwe are able to learn local volatility, as well as path-dependence required inthe volatility process to minimize the price of a Bermudan option. In onesentence, our algorithm can be seen as a particle method \`{a} la Guyon etHenry-Labordere where particles, instead of being designed to ensure$\sigma_{loc}(t,S_t)^2 = \mathbb{E}[\sigma_t^2|S_t]$, are learning RL-drivenagents cooperating towards more general calibration targets. This is the firstwork bridging reinforcement learning with the derivative calibration problem.