Deep Reinforcement Learning for Cryptocurrency Trading: Practical Approach to Address Backtest Overfitting

  • 2022-09-23 09:23:47
  • Berend Jelmer Dirk Gort, Xiao-Yang Liu, Xinghang Sun, Jiechao Gao, Shuaiyu Chen, Christina Dan Wang
  • 0

Abstract

Designing profitable and reliable trading strategies is challenging in thehighly volatile cryptocurrency market. Existing works applied deepreinforcement learning methods and optimistically reported increased profits inbacktesting, which may suffer from the false positive issue due to overfitting.In this paper, we propose a practical approach to address backtest overfittingfor cryptocurrency trading using deep reinforcement learning. First, weformulate the detection of backtest overfitting as a hypothesis test. Then, wetrain the DRL agents, estimate the probability of overfitting, and reject theoverfitted agents, increasing the chance of good trading performance. Finally,on 10 cryptocurrencies over a testing period from 05/01/2022 to 06/27/2022(during which the crypto market crashed two times), we show that the lessoverfitted deep reinforcement learning agents have a higher Sharpe ratio thanthat of more over-fitted agents, an equal weight strategy, and the S&P DBMIndex (market benchmark), offering confidence in possible deployment to a realmarket.

 

Quick Read (beta)

loading the full paper ...