This content is not included in
your SAE MOBILUS subscription, or you are not logged in.
Criticality Assessment of Simulation-Based AV/ADAS Test Scenarios
Technical Paper
2022-01-0070
ISSN: 0148-7191, e-ISSN: 2688-3627
Annotation ability available
Sector:
Language:
English
Abstract
Testing any new safety technology of Autonomous Vehicles (AV) and Advanced Driver Assistance Systems (ADAS) requires simulation-based validation and verification. The specific scenarios used for testing, outline incidences of accidents or near-miss events. In order to simulate these scenarios, specific values for all the above parameters are required including the ego vehicle model. The ‘criticality’ of a scenario is defined in terms of the difficulty level of the safety maneuver. A scenario could be over-critical, critical, or under-critical. In over-critical scenarios, it is impossible to avoid a crash whereas, for under-critical scenarios, no action may be required to avoid a crash. The criticality of the scenario depends on various parameters e.g. speeds, distances, road/tire parameters, etc. In this paper, we propose a definition of criticality metric and identify the parameters such that a scenario becomes critical.
The criticality of a scenario should be independent of the controller or the driver model. Hence, we use an optimal control as the ‘best’ candidate. The proposed approach has three key steps - 1) obtain optimal control for given dynamic and static constraints, 2) compute the probability of a crash assuming small variations in model parameters and control action, and 3) compute occupancy metric over the criticality parameters design space. The occupancy metric, which is related to the value function of the optimal control, defines the criticality of the scenario. The key benefit of this approach is a clear definition of criticality metric which reflects the probability of collision. The proposed approach is demonstrated using an example of an obstacle avoidance maneuver.
Authors
Topic
Citation
Tulpule, P., Chen, B., and Vaidya, U., "Criticality Assessment of Simulation-Based AV/ADAS Test Scenarios," SAE Technical Paper 2022-01-0070, 2022, https://doi.org/10.4271/2022-01-0070.Also In
References
- Duy Son , T. , Bhave , A. , and Van Der Auweraer , H. Simulation-Based Testing Framework for Autonomous Driving Development Proceedings - 2019 IEEE International Conference on Mechatronics, ICM 2019 May 2019 576 583 10.1109/ICMECH.2019.8722847
- Thorn , E. , Kimmel , S. , and Chaka , M. Sep. 2018 https://www.nhtsa.gov/sites/nhtsa.gov/files/documents/13882-automateddrivingsystems_092618_v1a_tag.pdf
- Bhagat , A.S. , Karle , U. , Kale , J. , and Karle , M. Simulation based Verification & amp; Validation of AEBS SAE Technical Paper 2021-26-0128 1 Sep. 2021 10.4271/2021-26-0128
- Wachenfeld , W. and Winner , H. The Release of Autonomous Vehicles Auton. Driv. Tech. Leg. Soc. Asp. Jan. 2016 425 449 10.1007/978-3-662-48847-8_21
- Kibalama , D. , Chen , B.-S. , and Tulpule , P. 2022
- Laureshyn , A. , Svensson , Å. , and Hydén , C. Evaluation of Traffic Safety, based on Micro-Level Behavioural Data: Theoretical Framework and First Implementation Accid. Anal. Prev. 42 6 Nov. 2010 1637 1646 10.1016/J.AAP.2010.03.021
- Mahmud , S.M.S. , Ferreira , L. , Hoque , M.S. , and Tavassoli , A. Micro-Simulation Modelling for Traffic Safety: A Review and Potential Application to Heterogeneous Traffic Environment IATSS Res. 43 1 Apr. 2019 27 36 10.1016/J.IATSSR.2018.07.002
- Weng , B. , Rao , S.J. , Deosthale , E. , Schnelle , S. et al. Model Predictive Instantaneous Safety Metric for Evaluation of Automated Driving Systems IEEE Intell. Veh. Symp. Proc. 2020 1899 1906 10.1109/IV47402.2020.9304635
- Junietz , P. , Bonakdar , F. , Klamann , B. , and Winner , H. Criticality Metric for the Safety Validation of Automated Driving using Model Predictive Trajectory Optimization IEEE Conf. Intell. Transp. Syst. Proceedings, ITSC 2018-November Dec. 2018 60 65 10.1109/ITSC.2018.8569326
- Schreier , M. , Willert , V. , and Adamy , J. An Integrated Approach to Maneuver-Based Trajectory Prediction and Criticality Assessment in Arbitrary Road Environments IEEE Trans. Intell. Transp. Syst. 17 10 2751 2766 2016 10.1109/TITS.2016.2522507
- Polvara , R. , Sharma , S. , Wan , J. , Manning , A. et al. Obstacle Avoidance Approaches for Autonomous Navigation of Unmanned Surface Vehicles J. Navig. 71 1 Jan. 2018 241 256 10.1017/S0373463317000753
- Geng , C. , Mostefai , L. , Denai , M. , and Hori , Y. Direct Yaw-Moment Control of an In-Wheel-Motored Electric Vehicle Based on Body Slip Angle Fuzzy Observer IEEE Trans. Ind. Electron. 56 5 2009 1411 1419 10.1109/TIE.2009.2013737
- Sundström , O. and Guzzella , L. A Generic Dynamic Programming Matlab Function Proc. IEEE Int. Conf. Control Appl. 2009 1625 1630 10.1109/CCA.2009.5281131
- Ho , J. and Ermon , S. Generative Adversarial Imitation Learning Adv. Neural Inf. Process. Syst. Jun. 2016 4572 4580 Accessed: Oct. 17, 2021. [Online]. Available: https://arxiv.org/abs/1606.03476v1
- NHTSA 2015