This content is not included in your SAE MOBILUS subscription, or you are not logged in.
Effective Evaluation of Automated Driving Systems
ISSN: 0148-7191, e-ISSN: 2688-3627
Published March 28, 2017 by SAE International in United States
This content contains downloadable datasetsAnnotation ability available
In the last years various advanced driver assistance systems (ADAS) have been introduced on the market. More highly advanced functions up to automated driving functions are currently under research. By means of these functions partly automated driving in specific situations is already or will be realized soon, e.g. traffic jam assist. Besides the technical challenges to develop such automated driving functions for complex situations, e.g. construction or intersection areas, new approaches for the evaluation of these functions under different driving conditions are necessary, in order to assess the benefits and identify potential weaknesses. Classical approaches for evaluation and market sign off will require an extensive testing, which results in high costs and time demands. Therefore the classical approaches are hardly feasible taking into account higher levels of support and automation.
Today the final sign-off requires a high amount of real world tests. This cannot be provided for all possible driving situations for higher degrees of vehicle automation due to the influencing factors such as environmental conditions, infrastructure and behavior of other traffic participants. The high amounts as well as the different combination of situations require thousands of test kilometers in order to cover all relevant driving situations. Furthermore evaluation of ADAS needs to consider the conflict of interest between acceptance, effectiveness and controllability as well as to ensure the fulfillment of the functional safety requirement defined in the ISO 26262. Taking this into account, this paper presents the systematic approach to evaluate a traffic jam assist feature. This feature supports the driver in traffic jam situations by means of longitudinal and lateral control support using a radar and a camera sensor. In this context, this paper describes a systematic approach to evaluate road vehicles with automated driving functions.
CitationBenmimoun, M., "Effective Evaluation of Automated Driving Systems," SAE Technical Paper 2017-01-0031, 2017, https://doi.org/10.4271/2017-01-0031.
Data Sets - Support Documents
|Unnamed Dataset 1|
- Rowsome , F. What It's Like to Drive an Auto-Pilot Car Popular Science Monthly USA April 1958
- Eckstein , L. , Zlocki , A. Safety Potential of ADAS - Combined Methods for an Effective Evaluation ESV 2013 Seoul, South-Korea 2013
- N. N. ISO 26262 - Road vehicles - Functional safety 2011
- Knapp , A. , Neumann , M. , Brockmann , M. et, al Code of Practice - Design and Evaluation of ADAS PReVENT Response 3 2009
- N. N. Regulation No 79 of the Economic Commission for Europe of the United Nations (UN/ECE) - Uniform provisions concerning the approval of vehicles with regard to steering equipment, Addendum 78: Regulation No 79, Revision 2 2008
- Benmimoun , M. , Eckstein , L. How to deal with data sets from naturalistic driving tests? An effective approach for detection of critical driving without video data Transport Research Board Washington, DC 2014
- Winner , H. Die Freigabefalle des autonomen Fahrens 5. Darmstädter Kolloquium Technische Universität Darmstadt 2011
- Zlocki , A. , Eckstein , L. Combined Methods for an Effective Evaluation of Automated Driving Functions TRBs Second Annual Workshop on Road Vehicle Automation Stanford 2013
- Benmimoun , M. , Eckstein , L. Impact assessment of Adaptive Cruise Control (ACC) and Forward Collision Warning (FCW) within a Field Operational Test Journal of Intelligent Transportation and Urban Planning 2012
- N. N. Automated Driving - Levels of driving automation are defined in new SAE international standard J3016 SAE International 2016
- Zlocki , A. , Fahrenkrog , F. , Benmimoun , M. et al. Evaluation of Automated Road Vehicles, Transportation Research Board International Workshop on Road Vehicle Automation Standford University 2014
- Donges , E. Aspekte der aktiven Sicherheit bei der Führung von Personenkraftwagen Automobil- Industrie 2 2 1978
- N. N. PELOPS White Paper, Forschungsgesellschaft Kraftfahrwesen mbH Aachen (fka) 2010
- Merat , N. , Jamson , A. H. , Lai , F. C. H. , Carsten , O. Highly Automated Driving, Secondary Task Performance, and Driver State Human Factors 54 5 762 771 2012
- Endsley , M. R. Toward a Theory of Situation Awareness in Dynamic Systems Human Factors 37 1 32 64 1995
- Larsson , P. , Esberg , I. et al. interactIVe- Test and evaluation plans interactIVe Deliverable D7.4 2012