Optimal Market Making by Reinforcement Learning

  • 2021-04-08 20:13:21
  • Matias Selser, Javier Kreiner, Manuel Maurette
  • 6


We apply Reinforcement Learning algorithms to solve the classic quantitativefinance Market Making problem, in which an agent provides liquidity to themarket by placing buy and sell orders while maximizing a utility function. Theoptimal agent has to find a delicate balance between the price risk of herinventory and the profits obtained by capturing the bid-ask spread. We designan environment with a reward function that determines an order relation betweenpolicies equivalent to the original utility function. When comparing our agentswith the optimal solution and a benchmark symmetric agent, we find that theDeep Q-Learning algorithm manages to recover the optimal agent.


Quick Read (beta)

loading the full paper ...