Abstract
In this paper, we develop a reinforcement learning (RL) based system to learnan effective policy for carpooling that maximizes transportation efficiency sothat fewer cars are required to fulfill the given amount of trip demand. Forthis purpose, first, we develop a deep neural network model, called ST-NN(Spatio-Temporal Neural Network), to predict taxi trip time from the raw GPStrip data. Secondly, we develop a carpooling simulation environment for RLtraining, with the output of ST-NN and using the NYC taxi trip dataset. Inorder to maximize transportation efficiency and minimize traffic congestion, wechoose the effective distance covered by the driver on a carpool trip as thereward. Therefore, the more effective distance a driver achieves over a trip(i.e. to satisfy more trip demand) the higher the efficiency and the less willbe the traffic congestion. We compared the performance of RL learned policy toa fixed policy (which always accepts carpool) as a baseline and obtainedpromising results that are interpretable and demonstrate the advantage of ourRL approach. We also compare the performance of ST-NN to that ofstate-of-the-art travel time estimation methods and observe that ST-NNsignificantly improves the prediction performance and is more robust tooutliers.