Abstract
Urban Traffic Control (UTC) plays an essential role in IntelligentTransportation System (ITS) but remains difficult. Since model-based UTCmethods may not accurately describe the complex nature of traffic dynamics inall situations, model-free data-driven UTC methods, especially reinforcementlearning (RL) based UTC methods, received increasing interests in the lastdecade. However, existing DL approaches did not propose an efficient algorithmto solve the complicated multiple intersections control problems whosestate-action spaces are vast. To solve this problem, we propose a DeepReinforcement Learning (DRL) algorithm that combines several tricks to masteran appropriate control strategy within an acceptable time. This new algorithmrelaxes the fixed traffic demand pattern assumption and reduces human inventionin parameter tuning. Simulation experiments have shown that our methodoutperforms traditional rule-based approaches and has the potential to handlemore complex traffic problems in the real world.