Multi-agent Traffic Light Controls with SUMO

Somnuk Phon-Amnuaisuk, Soon-Jiann Tan, Yok-Hoe Yap, Florence Chiao-Mei Choong, Pikul Vejjanugraha, Kok-Chin Khor, Keng-Hoong Ng

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

This study focuses on the optimization of Traffic Light System (TLS) control through the use of adaptive agents. The performance of adaptive cycle TLS was compared with fixed cycle TLS. Two different adaptive cycle TLS agents were investigated, reactive and Deep Q-Network (DQN) agents. The reactive agent adjusted its control signals based on traffic measures such as queue length, while the DQN agent employed a deep reinforcement learning algorithm to determine its control signals. Two sets of simulations were conducted to evaluate the performance of both approaches. The results showed that the adaptive cycle TLS was more effective in reducing waiting times and increasing traffic throughput than the fixed cycle TLS. Among the adaptive agents, the reactive agent outperformed the DQN agent, due to the difficulty in learning an optimal policy in the traffic control domain, which has a non-stationary and complex nature. This preliminary study showed the potential benefits of using adaptive agents for traffic light control, and further studies in various areas such as employing more advanced TLS control methods, expanding the scale of the study, and applying real-demand in the simulation, could be carried out in future work.
Original languageEnglish
Title of host publication8th International Conference on Business and Industrial Research (ICBIR 2023)
PublisherIEEE
Pages824-830
Number of pages7
ISBN (Electronic)9798350399646
DOIs
Publication statusPublished - 19 Jun 2023
Event8th International Conference on Business and Industrial Research 2023 - Bangkok, Thailand
Duration: 18 May 202319 May 2023

Conference

Conference8th International Conference on Business and Industrial Research 2023
Abbreviated titleICBIR 2023
Country/TerritoryThailand
CityBangkok
Period18/05/2319/05/23

Keywords

  • SUMO simulation
  • multi-agent system
  • reactive agent
  • reinforcement learning
  • traffic light control

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Science Applications
  • Strategy and Management
  • Computer Vision and Pattern Recognition
  • Information Systems and Management
  • Industrial and Manufacturing Engineering
  • Safety, Risk, Reliability and Quality

Fingerprint

Dive into the research topics of 'Multi-agent Traffic Light Controls with SUMO'. Together they form a unique fingerprint.

Cite this