Driving Behavior Modeling Based on Inverse Reinforcement Learning

2024-01-7029

12/13/2024

Features
Event
SAE 2024 Intelligent and Connected Vehicles Symposium
Authors Abstract
Content
With the advancement of intelligent driving technology, today’s smart vehicles must not only make accurate and safe driving decisions but also exhibit high human-likeness to ensure better acceptance from people. Developing vehicle behavior models with increased human-likeness has become a significant industry focus. However, existing vehicle behavior models often struggle to balance human-likeness and interpretability. While some researchers use inverse reinforcement learning (IRL) to model vehicle behavior, ensuring both human-likeness and a degree of interpretability, challenges such as reward function design difficulties and low human-likeness in background vehicle modeling persist. This study addresses these issues by focusing on highway scenarios without on-ramps, specifically following and lane-changing behaviors, using the CitySim dataset. IRL is employed to create a vehicle behavior model with improved human-likeness, utilizing a linear reward function to capture driver decision-making motives. Building on prior research, this study further explores various feature combinations for the reward function and introduces new features. The final feature combination resulted in a 12.6% and 14.4% reduction in planning errors on the training and test sets, respectively, compared to the baseline method. Additionally, the study enhances background vehicle modeling methods based on the Intelligent Driver Model (IDM) and the Minimizing Overall Braking Induced by Lane-change (MOBIL) model by adding traffic flow and patience correction terms. The results show that the improved background vehicle modeling method reduced test set errors by 4.3%, demonstrating greater human-likeness and making it more suitable for simulation environments.
Meta TagsDetails
DOI
https://doi.org/10.4271/2024-01-7029
Pages
12
Citation
Xu, X., Han, W., Leng, B., and Xiong, L., "Driving Behavior Modeling Based on Inverse Reinforcement Learning," SAE Technical Paper 2024-01-7029, 2024, https://doi.org/10.4271/2024-01-7029.
Additional Details
Publisher
Published
Dec 13, 2024
Product Code
2024-01-7029
Content Type
Technical Paper
Language
English