This content is not included in
your SAE MOBILUS subscription, or you are not logged in.
Methodologies for Evaluating and Optimizing Multimodal Human-Machine-Interface of Autonomous Vehicles
Technical Paper
2018-01-0494
ISSN: 0148-7191, e-ISSN: 2688-3627
This content contains downloadable datasets
Annotation ability available
Sector:
Language:
English
Abstract
With the rapid development of artificial intelligence, autonomous driving technology will finally reshape an automotive industry. Although fully autonomous cars are not commercially available to common consumers at this stage, partially autonomous vehicles, which are defined as level 2 and level 3 autonomous vehicles by SAE J3016 standard, are widely tested by automakers and researchers.
A typical Human-Machine-Interface (HMI) for a vehicle takes a form to support a human domination role. Although modern driving assistance systems allow vehicles to take over control at certain scenarios, the typical human-machine-interface has not changed dramatically for a long time. With deep learning neural network technologies penetrating into automotive applications, multi-modal communications between a driver and a vehicle can be enabled by a cost-effective solution. The multi-modal human-machine-interface will allow a driver to easily interact with autonomous vehicles, supporting smooth switching between human manual control and automation. However, unlike a steering wheel of vehicles, there is no normal or standard multi-modal human-machine-interface for autonomous vehicles. Moreover, unlike buttons and knobs, which cause little confusions in applications across different countries, multi-modal communications are affected by cultural nuances. Automotive Original Equipment Manufacturers (OEMs) can promote the typical human-machine-interface in different countries or automotive markets with little adaption, but OMEs need to adjust multi-modal human-machine-interface by taking into consideration cultural impacts, driving habits, social cognition and a traffic legal system. Design methodologies for human-machine-interface systems on different level autonomous vehicles are elaborated.
The goal of multi-modal human-machine-interface in partially driving autonomous vehicles (SAE level 2 autonomous vehicles) and conditionally driving autonomous vehicles (SAE level 3 autonomous vehicles) is not only to mitigate a driver’s fatigue during driving, but also to keep certain amount of the driver’s engagement to ensure that the driver can take over control in a short time when the switching is necessary. The two sides of the design goal of multi-modal HMI systems are actually on a trade-off curve. Methodologies to optimize multi-modal communications to support HMI design are elaborated and compared in this paper.
Recommended Content
Authors
Topic
Citation
Ge, X., Li, X., and Wang, Y., "Methodologies for Evaluating and Optimizing Multimodal Human-Machine-Interface of Autonomous Vehicles," SAE Technical Paper 2018-01-0494, 2018, https://doi.org/10.4271/2018-01-0494.Data Sets - Support Documents
Title | Description | Download |
---|---|---|
Unnamed Dataset 1 | ||
Unnamed Dataset 2 | ||
Unnamed Dataset 3 | ||
Unnamed Dataset 4 | ||
Unnamed Dataset 5 | ||
Unnamed Dataset 6 | ||
Unnamed Dataset 7 | ||
Unnamed Dataset 8 | ||
Unnamed Dataset 9 |
Also In
References
- Taxonomy and Definitions for Terms Related to Driving Automation Systems for On-Road Motor Vehicles
- Benmimoun , M. Effective Evaluation of Automated Driving Systems SAE Technical Paper 2017-01-0031 2017 10.4271/2017-01-0031
- Serter , B. , Beul , C. , Lang , M. , and Schmidt , W. Foreseeable Misuse in Automated Driving Vehicles - The Human Factor in Fatal Accidents of Complex Automation SAE Technical Paper 2017-01-0059 2017 10.4271/2017-01-0059
- Li , X. , Ge , X. , and Wang , Y. The Psychological and Statistical Design Method for Co-Creation HMI Applications in the Chinese Automotive Market SAE Technical Paper 2017-01-0650 2017 10.4271/2017-01-0650
- Sauras-Perez , P. , Gil , A. , Singh Gill , J. , Pisu , P. et al. VoGe: A Voice and Gesture System for Interacting with Autonomous Cars SAE Technical Paper 2017-01-0068 2017 10.4271/2017-01-0068
- Heineke , K. , Kampshoff , P. , Mkrtchyan , A. et al.
- Guo , L. , Manglani , S. , Li , X. , and Jia , Y. Teaching Autonomous Vehicles How to Drive under Sensing Exceptions by Human Driving Demonstrations SAE Technical Paper 2017-01-0070 2017 10.4271/2017-01-0070
- http://dschool.stanford.edu/use-our-methods/
- Stickdorn , M. and Schneider , J. 2012
- Moorthy , A. , De Kleine , R. , Keoleian , G. , Good , J. et al. Shared Autonomous Vehicles as a Sustainable Solution to the Last Mile Problem: A Case Study of Ann Arbor-Detroit Area SAE Int. J. Passeng. Cars - Electron. Electr. Syst. 10 2 2017 10.4271/2017-01-1276