This content is not included in your SAE MOBILUS subscription, or you are not logged in.
A Study of Using a Reinforcement Learning Method to Improve Fuel Consumption of a Connected Vehicle with Signal Phase and Timing Data
ISSN: 0148-7191, e-ISSN: 2688-3627
Published April 14, 2020 by SAE International in United States
This content contains downloadable datasetsAnnotation ability available
Connected and automated vehicles (CAVs) promise to reshape two areas of the mobility industry: the transportation and driving experience. The connected feature of the vehicle uses communication protocols to provide awareness of the surrounding world while the automated feature uses technology to minimize driver dependency. Constituting a subset of connected technologies, vehicle-to-infrastructure (V2I) technologies provide vehicles with real-time traffic light information, or Signal Phase and Timing (SPaT) data. In this paper, the vehicle and SPaT data are combined with a reinforcement learning (RL) method as an effort to minimize the vehicle’s energy consumption. Specifically, this paper explores the implementation of the deep deterministic policy gradient (DDPG) algorithm. As an off-policy approach, DDPG utilizes the maximum Q-value for the state regardless of the previous action performed. In this research, the SPaT data collected from dedicated short-range communication (DSRC) hardware installed at 16 real traffic lights is utilized in a simulated road modeled after a road in Tuscaloosa, Alabama. The vehicle is trained using DDPG with the SPaT data which then determines the optimal action to take in order to minimize the energy consumption at each traffic light.
CitationPhan, A. and Yoon, H., "A Study of Using a Reinforcement Learning Method to Improve Fuel Consumption of a Connected Vehicle with Signal Phase and Timing Data," SAE Technical Paper 2020-01-0888, 2020, https://doi.org/10.4271/2020-01-0888.
Data Sets - Support Documents
|[Unnamed Dataset 1]|
|[Unnamed Dataset 2]|
- “Save Money and Fuel by Driving Efficiently,” www.fueleconomy.gov, the official government source for fuel economy information, https://www.fueleconomy.gov/feg/driveHabits.jsp, accessed November 8, 2019.
- “Alabama Researchers Develop Next-Generation Transportation System,” Traffic Technology Today, October 1, 2019. https://www.traffictechnologytoday.com/news/congestion-reduction/alabama-researchers-develop-next-generation-transportation-system.html.
- Alexander-Kearns, M. , “The Impact of Vehicle Automation on Carbon Emissions,” Center for American Progress. January 14, 2020, www.americanprogress.org/issues/green/reports/2016/11/18/292588/the-impact-of-vehicle-automation-on-carbon-emissions-where-uncertainty-lies.
- Yoon, Chris . “Deep Deterministic Policy Gradients Explained Medium Towards Data Science,” May 23, 2019. https://towardsdatascience.com/deep-deterministic-policy-gradients-explained-2d94655a9b7b.
- “Crash Data Analyses for Vehicle-to-Infrastructure Communications for Safety Applications.” U.S. Department of Transportation, October 1, 2019. www.fhwa.dot.gov/publications/research/connectedvehicles/11040/11040.pdf.
- Djahel, S. , “Toward V2I Communication Technology- Based Solution for Reducing Road Traffic Congestion in Smart Cities,” https://ieeexplore.ieee.org/document/7238584, accessed November 8, 2019.
- Khakhutskyy, V. , “Signal Phase and Timing Prediction for Intelligent Transportation Systems,” https://pdfs.semanticscholar.org/53ca/2372f3702ae9cc7dd048c543ee9c1fe56bfc.pdf, accessed November 9, 2019.
- Du, Z., Qiu, L., Pisu, P. , “Hierarchical Energy Management Control of Connected Hybrid Electric Vehicles on Urban Roads with Efficiencies Feedback,” https://asmedigitalcollection.asme.org/DSCC/proceedings/DSCC2016/50695/V001T16A002/228486, accessed January 9, 2020.
- Xin, Q., Moonam, H., Ala, V., Mani ., “Connected Eco-Driving Technologies for Adaptive Traffic Signal Control,” https://trid.trb.org/view/1600652, accessed January 9, 2020.