Abstract
Free-flow road networks, such as suburban highways, are increasinglyexperiencing traffic congestion due to growing commuter inflow and limitedinfrastructure. Traditional control mechanisms, such as traffic signals orlocal heuristics, are ineffective or infeasible in these high-speed,signal-free environments. We introduce self-regulating cars, a reinforcementlearning-based traffic control protocol that dynamically modulates vehiclespeeds to optimize throughput and prevent congestion, without requiring newphysical infrastructure. Our approach integrates classical traffic flow theory,gap acceptance models, and microscopic simulation into a physics-informed RLframework. By abstracting roads into super-segments, the agent capturesemergent flow dynamics and learns robust speed modulation policies frominstantaneous traffic observations. Evaluated in the high-fidelity PTV Vissimsimulator on a real-world highway network, our method improves total throughputby 5%, reduces average delay by 13%, and decreases total stops by 3% comparedto the no-control setting. It also achieves smoother, congestion-resistant flowwhile generalizing across varied traffic patterns, demonstrating its potentialfor scalable, ML-driven traffic management.