Abstract
Reinforcement learning (RL), given its adaptability and generality, has great potential to optimize online traffic signal control strategies. Although studies have proposed various RL-based signal controllers and validated them offline, very few examine the robustness of the trained RL-based controllers when deployed in a dynamic traffic environment. This paper proposed a multi-agent reinforcement learning algorithm for traffic signal control and developed a general multi-agent optimization simulation tool to evaluate different signal control methods. A transfer learning technique is applied to test the robustness of the proposed algorithm and traditional control approaches under different traffic scenarios, including stochastic traffic flow, varying traffic volume, and uncertain sensor data. The experimental results show that the proposed RL-based control method is robust under stochastic traffic flow and variation traffic demand patterns, and it outperforms the fixed-time and vehicle-actuated methods. However, it is unstable in the case of highly noisy sensor data. Also, the trained RL-based controller can continuously learn online and improve its performance by interacting with the dynamic traffic environment, especially when the traffic is congested, and the sensor has noisy observations.
Original language | English |
---|---|
Title of host publication | 2020 IEEE 23rd International Conference on Intelligent Transportation Systems, ITSC 2020 |
Publisher | IEEE, Institute of Electrical and Electronics Engineers |
ISBN (Electronic) | 9781728141497 |
DOIs | |
Publication status | Published - 2020 |
Event | IEEE Conference on Intelligent Transportation Systems 2020 - Rhodes, Greece Duration: 20 Sept 2020 → 23 Sept 2020 Conference number: 23rd http://www.itsc2020.org (Website) |
Conference
Conference | IEEE Conference on Intelligent Transportation Systems 2020 |
---|---|
Abbreviated title | ITSC 2020 |
Country/Territory | Greece |
City | Rhodes |
Period | 20/09/20 → 23/09/20 |
Internet address |
|