Search tips
Open Access

Multi-agent Decision-Making Framework Based on Value Decomposition for Connected Automated Vehicles at Highway On-Ramps

Journal Article
12-06-03-0016
ISSN: 2574-0741, e-ISSN: 2574-075X
DOI: https://doi.org/10.4271/12-06-03-0016
Published January 16, 2023 by SAE International in United States
Multi-agent Decision-Making Framework Based on Value Decomposition for Connected Automated Vehicles at Highway On-Ramps
Sector:
Citation: Wang, J., Ma, Z., and Zhu, X., "Multi-agent Decision-Making Framework Based on Value Decomposition for Connected Automated Vehicles at Highway On-Ramps," SAE Intl. J CAV 6(3):253-261, 2023, https://doi.org/10.4271/12-06-03-0016.
Language: English

Abstract:

Recognition of the necessity of connected and automated vehicles (CAVs) in transportation systems is gaining momentum. CAVs can improve the transportation network efficiency and safety by sharing information and cooperative control. This article addresses the problem of coordinating CAVs at highway on-ramps to achieve smooth traffic flow. We develop a multi-agent reinforcement learning (MARL) method based on value decomposition and centralized control to coordinate CAVs. The simulation results show that the proposed collaborative decision-making framework can effectively coordinate dynamic traffic flows and improve the metrics by more than 10% compared to the baseline methods under high traffic demand scenarios.