Abstract
Deep reinforcement learning (DRL) has revolutionized quantitative trading(Q-trading) by achieving decent performance without significant human expertknowledge. Despite its achievements, we observe that the currentstate-of-the-art DRL models are still ineffective in identifying the markettrends, causing them to miss good trading opportunities or suffer from largedrawdowns when encountering market crashes. To address this limitation, anatural approach is to incorporate human expert knowledge in identifying markettrends. Whereas, such knowledge is abstract and hard to be quantified. In orderto effectively leverage abstract human expert knowledge, in this paper, wepropose a universal logic-guided deep reinforcement learning framework forQ-trading, called Logic-Q. In particular, Logic-Q adopts the program synthesisby sketching paradigm and introduces a logic-guided model design that leveragesa lightweight, plug-and-play market trend-aware program sketch to determine themarket trend and correspondingly adjusts the DRL policy in a post-hoc manner.Extensive evaluations of two popular quantitative trading tasks demonstratethat Logic-Q can significantly improve the performance of previousstate-of-the-art DRL trading strategies.