This content is not included in
your SAE MOBILUS subscription, or you are not logged in.
Evaluation of Operational Safety Assessment (OSA) Metrics for Automated Vehicles in Simulation
Technical Paper
2021-01-0868
ISSN: 0148-7191, e-ISSN: 2688-3627
This content contains downloadable datasets
Annotation ability available
Sector:
Event:
SAE WCX Digital Summit
Language:
English
Abstract
The operational safety of automated driving system (ADS)-equipped vehicles (AVs) must be quantified using well-defined metrics in order to gain an unambiguous understanding of the level of risk associated with AV deployment on public roads. In this research, efforts to evaluate the operational safety assessment (OSA) metrics introduced in prior work by the Institute of Automated Mobility (IAM) are described. An initial validation of the proposed set of OSA metrics involved using the open-source simulation software Car Learning to Act (CARLA) and Scenario Runner, which are used to place a subject vehicle in selected scenarios and obtain measurements for the various relevant OSA metrics. Car following scenarios were selected from the list of 37 pre-crash scenarios identified by the National Highway Traffic Safety Administration (NHTSA) as the most common driving situations that lead to crash events involving two light vehicles. The resulting data were used to evaluate different parameters and thresholds of the metrics developed in the prior IAM work. The simulation and analysis results were used to evaluate the relevant metrics in the context of a proposed criteria as measurable and applicable to the operational safety of AVs and human-driven vehicles alike in a data-driven approach.
Authors
Citation
Elli, M., Wishart, J., Como, S., Dhakshinamoorthy, S. et al., "Evaluation of Operational Safety Assessment (OSA) Metrics for Automated Vehicles in Simulation," SAE Technical Paper 2021-01-0868, 2021, https://doi.org/10.4271/2021-01-0868.Data Sets - Support Documents
| Title | Description | Download |
|---|---|---|
| Unnamed Dataset 1 | ||
| Unnamed Dataset 2 | ||
| Unnamed Dataset 3 | ||
| Unnamed Dataset 4 | ||
| Unnamed Dataset 5 | ||
| Unnamed Dataset 6 | ||
| Unnamed Dataset 7 | ||
| Unnamed Dataset 8 |
Also In
References
- Safetyengineering.wordpress.com April 18, 2008
- Underwriters Laboratories (UL) 2020
- Wishart , J. , Como , S. , Elli , M. , Russo , B. et al. Driving Safety Performance Assessment Metrics for ADS-Equipped Vehicles SAE Technical Paper 2020-01-1206 2020 https://doi.org/10.4271/2020-01-1206
- Dosovitskiy , A. , Ros , G. , Codevilla , F. , Lopez , A. , and Koltun , V. CARLA: An Open Urban Driving Simulator 1st Annual Conference on Robot Learning 2017
- https://github.com/carla-simulator/scenario_runner
- Wassim , N. , Ranganathan , R. , Srinivasan , G. , Smith , J. , Toma , S. , Swanson , E. , and Burgett , A. 731 2013
- Najm , W.G. , Smith , J.D. , and Yanagisawa , M. 2007
- Shalev-Shwartz , S. , Shammah , S. , and Shashua , A. On a Formal Model of Safe and Scalable Self-Driving Cars 2017
- Gettman , D. and Head , L. Surrogate Safety Measures from Traffic Simulation Models 1840 1 104 115 2003
- United Nations Economic Commission for Europe (UNECE) Proposal for a New UN Regulation on Uniform Provisions Concerning the Approval of Vehicles with Regards to Automated Lane Keeping System 2020 https://undocs.org/ECE/TRANS/WP.29/2020/81
- Silberling , J. , Wells , P. , Acharya , A. , Kelly , J. , and Lenkeit , J. Development and Application of a Collision Avoidance Capability Metric SAE Technical Paper 2020-01-1207 2020 https://doi.org/10.4271/2020-01-1207
- Weng , B. , Rao , S. , Deosthale , E. , Schnelle , S. , and Barickman , F. Model Predictive Instantaneous Safety Metric for Evaluation of Automated Driving Systems IEEE Intelligent Vehicles Symposium (IV) 2020
- Javed , M.A. and Khan , J.Y. Performance Analysis of a Time Headway Based Rate Control Algorithm for VANET Safety Applications 7th International Conference on Signal Processing and Communication Systems (ICSPCS) Carrara VIC 2013
- Rodionova , A. , Alvarez , I. , Elli , M.S. , Oboril , F. , Quast , J. , and Mangharam , R. How Safe Is Safe Enough? Automatic Safety Constraints Boundary Estimation for Decision-Making in Automated Vehicles IEEE Intelligent Vehicles Symposium (IV) 2020
- China Intelligent Transportation Systems (ITS) Alliance 2020
- ASAM OpenScenario https://www.asam.net/standards/detail/openscenario/
- Gassmann , B. , Oboril , F. , Buerkle , C. , Liu , S. et al. Towards Standardization of AV Safety: C++ Library for Responsibility Sensitive Safety IEEE Intelligent Vehicles Symposium (IV) 2019
- Gassmann , B. , Pasch , F. , Oboril , F. , and Scholl , K.-U. Integration of Formal Safety Models on System Level Using the Example of Responsibility Sensitive Safety and CARLA Driving Simulator International Conference on Computer Safety, Reliability, and Security 2020
- Mazzae , E.N. , Barickman , F.S. , Forkenbrock , G. , and Baldwin , G.H. NHTSA Light Vehicle Antilock Brake System Research Program Task 5.2/5.3: Test Track Examination of Drivers’ Collision Avoidance Behavior Using Conventional and Antilock Brakes DOT HS 809 2003
- Balas , V.E. and Balas , M.M. Driver Assisting by Inverse Time to Collision World Automation Congress (WAC) Budapest 2006