A neuro-dynamic programming approach for perimeter control of two urban regions with macroscopic fundamental diagrams

Z. C. Su, Andy H.F. Chow, N. Zheng, Y. P. Huang, R. X. Zhong

Research output: Chapter in Book/Report/Conference proceedingConference PaperOther

2 Citations (Scopus)


Macroscopic Fundamental Diagram (MFD) model is widely used to describe urban traffic dynamic system. Based on the MFD model, perimeter control methods are developed to ensure the efficiency of the system. However, most existing perimeter control methods would suffer from two shortcomings, i.e., linearization of the MFD function, accurate calibration of MFD and travel demand. These prerequisites would undermine the performance of the system if an accurate calibration cannot be guaranteed. On the other hand, an optimization scheme of network performance without excessive knowledge of state variables but based on traffic data is preferable. In this study, an optimal feedback controller based on the neuro-dynamic that approximates the solution of the Hamilton-Jacobi-Bellman equation (HJB) is introduced. Firstly, the value function is approximated by a neural network. Then the parameters are optimized by the policy iteration method, with the objective of minimizing the cumulative error toward set-point. Furthermore, the optimal control law constrained by a saturated operator is implemented based on real-time observations recursively. The neuro-dynamic controller is tested for the two-regional MFD system. The results confirm that the neuro-dynamic controller can regulate the traffic states converge to the desired uncongested equilibrium.

Original languageEnglish
Title of host publication2019 IEEE Intelligent Transportation Systems Conference (ITSC 2019)
PublisherIEEE, Institute of Electrical and Electronics Engineers
Number of pages6
ISBN (Electronic)9781538670248
Publication statusPublished - Oct 2019
EventIEEE Conference on Intelligent Transportation Systems 2019 - Auckland, New Zealand
Duration: 27 Oct 201930 Oct 2019
Conference number: 22nd
https://ieeexplore.ieee.org/xpl/conhome/8907344/proceeding (Proceedings)


ConferenceIEEE Conference on Intelligent Transportation Systems 2019
Abbreviated titleITSC 2019
Country/TerritoryNew Zealand
Internet address

Cite this