This content is not included in
your SAE MOBILUS subscription, or you are not logged in.
Foreseeable Misuse in Automated Driving Vehicles - The Human Factor in Fatal Accidents of Complex Automation
Technical Paper
2017-01-0059
ISSN: 0148-7191, e-ISSN: 2688-3627
Annotation ability available
Sector:
Language:
English
Abstract
Today, highly automated driving is paving the road for full autonomy. Highly automated vehicles can monitor the environment and make decisions more accurately and faster than humans to create safer driving conditions while ultimately achieving full automation to relieve the driver completely from participating in driving. As much as this transition from advanced driving assistance systems to fully automated driving will create frontiers for re-designing the in-vehicle experience for customers, it will continue to pose significant challenges for the industry as it did in the past and does so today. As we transfer more responsibility, functionality and control from human to machine, technologies become more complex, less transparent and making constant safe-guarding a challenge. With automation, potential misuse and insufficient system safety design are important factors that can cause fatal accidents, such as in TESLA autopilot incident. This paper investigates the human factor in fatal accidents from foreseeable misuse and insufficient system safety design perspectives. Fatal incidents, caused by different generations of autonomous systems are analyzed. Liability and product compliance topics of safety critical systems, procedures and controlled environment, are investigated for US regulations. Competency of automotive industry standards are evaluated within today’s automation needs, and compared against proven-in-use standards from other industries, especially from aviation. As a result, this paper unveils industry challenges in complex automated systems, caused by human factor, foreseeable misuse and insufficient system safety design to prevent fatal incidents.
Recommended Content
Authors
Topic
Citation
Serter, B., Beul, C., Lang, M., and Schmidt, W., "Foreseeable Misuse in Automated Driving Vehicles - The Human Factor in Fatal Accidents of Complex Automation," SAE Technical Paper 2017-01-0059, 2017, https://doi.org/10.4271/2017-01-0059.Also In
References
- SAE Surface Vehicle Recommended Practice Taxonomy and Definitions for Terms Related to Driving Automation Systems for On-Road Motor Vehicles SAE J3016 Sep. 2016
- Wood , Stephen P. The Potential Regulatory Challenges of Increasingly Autonomous Motor Vehicles Santa Clara Law Review 52 4 December 20 2012 October 11 2016 http://digitalcommons.law.scu.edu/cgi/viewcontent.cgi?article=2734&context=lawreview
- automated Dictionary.com Dictionary.com Unabridged. Random House, Inc. http://www.dictionary.com/browse/autonomous October 12 2016
- autonomous Dictionary.com Dictionary.com Unabridged Random House, Inc. http://www.dictionary.com/browse/autonomous October 12 2016
- Merriam-Webster’s Collegiate Dictionary 11th Springfield, MA Merriam-Webster 2003 http://www.merriam-webster.com/
- U.S. Department of Transportation Federal Automated Vehicles Policy - September 2016 Department of Transportation October 10 2016 https://www.transportation.gov/AV/federal-automated-vehicles-policy-september-2016
- The Tesla Team Upgrading Autopilot: Seeing the World in Radar TESLA Blog (blog) September 11 2016 October 11 2016 https://www.tesla.com/de_DE/blog/upgrading-autopilot-seeing-world-radar-0?redirect=no
- United States Department of Transportation. National Highway Traffic Safety Administration. Traffic Safety Facts 2014: Motor Vehicle Crash Data from Fatality Analysis Reporting System (FARS) and the General Estimates System (GES) Washington, DC U.S. Department of Transportation 2016 213
- Antonio Chialastri 2012 Automation in aviation, Automation Kongoli Florian Dr. InTech 10.5772/49949 http://www.intechopen.com/books/automation/automation-in-aviation
- Airbus - „Commercial Aviation Accidents 1958-2013 - A Statistical Analysis“, Posted by Aerossurance on Jun 22, 2014 in Accidents & Incidents, Design & Certification http://aerossurance.com/safety-management/airbus-report-commercial-aviation-accidents-1958-2013-statistical-analysis/ October 03 2016 http://asndata.aviation-safety.net/industry-reports/Airbus-Commercial-Aviation-Accidents-1958-2013.pdf
- Aviation Maintenance Technician Handbook -General U.S. Department of Transportation, Federal Aviation Administration, Airmen Testing Standards Branch AFS-630, P.O. Box 25082, Oklahoma City, OK 73125 2008
- Badke-Schaub , Petra Human Factors: Psychologie Sicheren Handelns in Risikobranchen; Mit 17 Tabellen Heidelberg Springer 2008
- Wiegmann , Douglas A. , and Shappell Scott A. The Human Factors Analysis and Classification System - HFACS
- Abott , Kathy , Dr. , Slotte Stephen M. , and Stimson Donald K. The Interfaces Between Flightcrews and Modern Flight Deck Systems Report. Federal Aviation Administration Human Factors Team September 20 2016
- Abgelenkt am Steuer - Handys lassen Unfallstatistik in die Höhe schießen February 22 2016 October 09 2016 https://www.welt.de/gesundheit/article152517510/Handys-lassen-Unfallstatistik-in-die-Hoehe-schiessen.html
- Keep Your Scanners Peeled Gaze Behavior as a Measure of Automation Trust During Highly Automated DrivingHuman Factors The Journal of the Human Factors and Ergonomics Society May 201658 509 519 February 3 2016 https://www.ncbi.nlm.nih.gov/pubmed/26843570
- Simonite , T. 2016 July 11 Tesla Investigations Could Question Viability of Semi-Autonomous Driving October 11 2016 https://www.technologyreview.com/s/601885/tesla-investigations-could-question-viability-of-semi-autonomous-driving/
- Chialastri Antonio 2012 Automation in aviation, Automation Kongoli Florian Dr. InTech 10.5772/49949 http://www.intechopen.com/books/automation/automation-in-aviation
- ISO 26262-1:2011 ISO October 12 2016 http://www.iso.org/iso/catalogue_detail?csnumber=43464
- American Society of Safety Engineers U.S. Department of Defense Draft Military Standard (MIL-STD-882E) Standard Practice for System Safety October 12 2016
- Federal Motor Vehicle Safety Standards and Regulations Federal Motor Vehicle Safety Standards and Regulations October 12 2016 http://icsw.nhtsa.gov/cars/rules/import/FMVSS/
- AUTOSAR: Basics Basics : AUTOSAR October 12 2016 https://www.autosar.org/about/basics/
- Site, MISRA Web MISRA Web Site Publications MISRA Web Site Publications October 12 2016 https://www.misra.org.uk/Publications/tabid/57/Default.aspx#label-c3
- SAE Surface Vehicle Recommended Practice Cybersecurity Guidebook for Cyber-Physical Vehicle Systems SAE J3061 Jan. 2016
- Who(What)’s Driving and When? Two New Studies Look at the Human Factors of Self-Driving Cars Through the Eyes and Ears of Drivers HFES News February 24 2016 October 11 2016 https://www.hfes.org/web/DetailNews.aspx?ID=397
- TESLA 2015 2015 Tesla Model S - Owner’s Manual TESLA Motors CA
- Automated Flight Controls faa.gov Federal Aviation Administration 20 February 2014
- Restatement of Torts, Third, Products Liability 1998 The American Law Institute
- ISO 26262:2011
- Germany Zeit Online GmbH Tesla: Tesla-Autopilot hielt Lkw für Verkehrsschild July 03 2016 October 10 2016 http://www.zeit.de/mobilitaet/2016-07/autonomes-fahren-tesla-unfall-model-s-autopilot-software
- Auto motor sport Autonomes Fahren: Die größten Probleme: Ampeln, Ethik und jede Menge Ärger August 26 2016 October 09 2016 http://www.auto-motor-und-sport.de/news/autonomes-fahren-probleme-2016-11523070.html
- Crots , Kevin , Skentzos Paul , and Bartz Dan A Comparative Analysis of Aviation and Ground Vehicle Software Development Standards 2014 NDIA GROUND VEHICLE SYSTEMS AND TECHNOLOGY SYMPOSIUM SYSTEMS ENGINEERING (SE ) TECHNICAL SESSION August 12-14, 2014
- SAE International Aerospace Recommended Practice Guidelines for Development of Civil Aircraft and Systems SAE ARP4754A Dec. 2010
- SAE International Aerospace Recommended Practice Guidelines and Methods for Conducting the Safety Assessment Process on Civil Airborne Systems and Equipment SAE ARP4761 Dec. 1996
- Germany SPIEGEL ONLINE Hamburg Autonomes Fahren: Was Soll Ihr Auto Jetzt Tun? - SPIEGEL ONLINE October 04 2016 http://www.spiegel.de/auto/aktuell/autonomes-fahren-moral-machine-gewissensfragen-zu-leben-und-tod-a-1108401.html
- Nees , M. A. , Helbein B. , and Porter A. Speech Auditory Alerts Promote Memory for Alerted Events in a Video-Simulated Self-Driving Car Ride Human Factors: The Journal of the Human Factors and Ergonomics Society 58 3 2016
- Autonomes Fahren: Michigan baut Testgelände für selbstfahrende Autos - manager magazin 2014 June 25 October 09 2016 http://www.manager-magazin.de/unternehmen/autoindustrie/autonomes-fahren-michigan-baut-testgelaende-fuer-selbstfahrende-autos-a-977472.html
- Orde 5050.4b U.S. DEPARTMENT OF TRANSPORTATION FEDERAL AVIATION ADMINISTRATION NATIONAL ENVIRONMENTAL POLICY ACT (NEPA) IMPLEMENTING INSTRUCTIONS FOR AIRPORT ACTIONS April 28 2016 October 10 2016 http://www.faa.gov/airports/resources/publications/orders/environmental_5050_4/media/5050-4b_complete.pdf
- Bundesregierung Die Strategie Automatisiertes Und Vernetztes Fahren Bundesministerium Für Verkehr Und Digitale Infrastruktur September 2015 www.bmvi.de
- Strategie Automatisiertes Und Vernetztes Fahren Report. Die Bundesregierung Berlin Bundesministerium Für Verkehr Und Digitale Infrastruktur 2015
- Virginia Tech Transportation Institute Virginia Tech Transportation Institute October 11 2016 http://www.vtti.vt.edu/news/news.html
- Fürst , Simon An open standardized software architecture for the automotive industry Lecture, 1st AUTOSAR Open Conference & 8th AUTOSAR Premium Member Conference Cobo Center Detroit, MI, USA December 26, 2016 http://www.autosar.org/fileadmin/files/events/2008-10-23-1st-autosar-open/03_AUTOSAR_Tutorial.pdf
- Tesla Third Quarter 2016 Update" (PDF). Tesla Motors. Palo Alto. 2016-10-26. Retrieved 2016-10-27.
- Blincoe , L. J. , Miller , T. R. , Zaloshnja , E. , & Lawrence , B. A. The economic and societal impact of motor vehicle crashes May 2015