Candlesticks are graphical representations of price movements for a givenperiod. The traders can discovery the trend of the asset by looking at thecandlestick patterns. Although deep convolutional neural networks have achievedgreat success for recognizing the candlestick patterns, their reasoning hidesinside a black box. The traders cannot make sure what the model has learned. Inthis contribution, we provide a framework which is to explain the reasoning ofthe learned model determining the specific candlestick patterns of time series.Based on the local search adversarial attacks, we show that the learned modelperceives the pattern of the candlesticks in a way similar to the human trader.