This content is not included in
your SAE MOBILUS subscription, or you are not logged in.
Automated Test Case Generation and Virtual Assessment Framework for UN Regulation on Automated Lane Keeping Systems
Technical Paper
2021-01-0870
ISSN: 0148-7191, e-ISSN: 2688-3627
Annotation ability available
Sector:
Event:
SAE WCX Digital Summit
Language:
English
Abstract
Validation of highly automated or autonomous vehicles is nowadays still a major challenge for the automotive industry. Furthermore, the homologation of ADAS/AD vehicles according to global regulations is getting more essential for their safe development and deployment around the world. In order to assure that the autonomous driving function is able to cope with the huge number of possible situations during operation, comprehensive testing of the functions is required. However, conventional testing approaches such as driving distance-based validation approach in the real world, can be time- and cost-consuming. Therefore, a scenario-based virtual validation and testing method is considered to be a proper solution.
In this paper, we propose a virtual assessment framework using a fully automated test case generation method. This framework is embedded into the continuous development and validation process. We conduct a detailed case study on an automated lane keep system (ALKS) function according to the UNECE regulation, hereby presenting the underlying framework and method. We utilize AVL ADAS Load Matrix to automatically generate test cases guided by a coverage metric and optimize the critical-case-finding process within a large parameter space to identify functional boundaries. We show the results of testing an ALKS system where the quality of testing is assured by the given quality metrics, while the effort of executing the test scenarios is reduced. Results obtained from initial test runs together with identified functional boundaries, form the basis for further development and validation steps. For the latter, the generated test scenarios can be re-used in a Hardware-in-the-Loop (HiL) environment, to allow for efficient performance, safety and regression testing throughout the whole development process. In terms of homologation, the presented testing process furthermore offers the opportunity to test and release the developed systems in a virtual world, before final homologation on proving ground and public road is conducted.
Recommended Content
Authors
Topic
Citation
Tao, J., Klueck, F., Felbinger, H., Nica, M. et al., "Automated Test Case Generation and Virtual Assessment Framework for UN Regulation on Automated Lane Keeping Systems," SAE Technical Paper 2021-01-0870, 2021, https://doi.org/10.4271/2021-01-0870.Also In
References
- SAE International Taxonomy and Definitions for Terms Related to Driving Automation Systems for On-Road Motor Vehicles SAE International J3016 2016
- Yadron , D. and Tynan , D. Tesla Driver Dies in First Fatal Crash While Using Autopilot Mode The Guardian 1 2016
- McCausland , P. Self-Driving Uber Car that Hit and Killed Woman Did Not Recognize that Pedestrians Jaywalk 2020
- EU Comission Intelligent Transport Systems https://ec.europa.eu/transport/themes/its/road_it 2019
- United Nations Economic Commission for Europe Information Unit https://www.unece.org/info/media/presscurrent-press-h/transport/2020/un-regulation-on-automated-lane-keeping-systems-is-milestone-for-safe-introduction-of-automated-vehicles-in-traffic/doc.html 2020
- Kalra , N. and Paddock , S.M. Driving to Safety: How Many Miles of Driving Would it Take to Demonstrate Autonomous Vehicle Reliability? Transportation Research Part A: Policy and Practice 94 182 193 2016
- Economic Commission for Europe Proposal for a New UN Regulation on Uniform Provisions Concerning the Approval of Vehicles with Regards to Automated Lane Keeping System https://undocs.org/ECE/TRANS/WP.29/2020/81 2020
- Klück , F. , Li , Y. , Nica , M. , Tao , J. , and Wotawa , F. Using Ontologies for Test Suites Generation for Automated and Autonomous Driving Functions Proc. of the 29th IEEE International Symposium on Software Reliability Engineering (ISSRE2018) 2018
- Li , Y. , Tao , J. , and Wotawa , F. Ontology-Based Test Generation for Automated and Autonomous Driving Functions Information and Software Technology 117 2020
- ASAM OpenScenario Standard https://www.asam.net/standards/detail/openscenario/
- ASAM OpenDrive Standard https://www.asam.net/standards/detail/opendrive/