This content is not included in your SAE MOBILUS subscription, or you are not logged in.
Additional Findings on the Multi-Modal Demands of “Voice-Command” Interfaces
Technical Paper
2016-01-1428
ISSN: 0148-7191, e-ISSN: 2688-3627
Annotation ability available
Sector:
Language:
English
Abstract
This paper presents the results of a study of how people interacted with a production voice-command based interface while driving on public roadways. Tasks included phone contact calling, full address destination entry, and point-of-interest (POI) selection. Baseline driving and driving while engaging in multiple-levels of an auditory-vocal cognitive reference task and manual radio tuning were used as comparison points. Measures included self-reported workload, task performance, physiological arousal, glance behavior, and vehicle control for an analysis sample of 48 participants (gender balanced across ages 21-68). Task analysis and glance measures confirm earlier findings that voice-command interfaces do not always allow the driver to keep their hands on the wheel and eyes on the road, as some assume. Self-reported workload, task completion time, glance metrics, and error rates varied significantly across the tasks, highlighting the importance of evaluating a particular design characteristic for specific tasks and exercising caution in generalizing across this class of user interfaces. For example, the “one-shot” voice-command structure in the study vehicle was associated with very low workload and error rates for phone contact calling, but much higher values for destination address entry and POI selection. Total task and eyes-off-road time were also relatively high for the latter tasks. However, mean single glance duration was nominally lower and the impact on major steering wheel reversals was less during the voice command tasks than during manual radio tuning, suggesting the importance of considering the comprehensive demand of an interface relative to other tasks in which the driver might engage.
Recommended Content
Authors
Citation
Mehler, B., Reimer, B., Dobres, J., Foley, J. et al., "Additional Findings on the Multi-Modal Demands of “Voice-Command” Interfaces," SAE Technical Paper 2016-01-1428, 2016, https://doi.org/10.4271/2016-01-1428.Also In
References
- Reimer, B., Mehler, B., Dobres, J., and Coughlin, J.F., “The Effects of a Production Level “Voice-Command” Interface on Driver Behavior: Reported Workload, Physiology, Visual Attention, and Driving Performance,” MIT AgeLab Technical Report No. 2013-17A. Massachusetts Institute of Technology, Cambridge, MA, 2013.
- National Highway Traffic Safety Administration, “Visual-Manual NHTSA Driver Distraction Guidelines for In-Vehicle Electronic Devices (Docket No. NHTSA-2010-0053),” Washington, DC: U.S. Department of Transportation National Highway Traffic Safety Administration (NHTSA), 2013.
- Driver Focus-Telematics Working Group, “Statement of Principles, Criteria and Verification Procedures on Driver Interactions with Advanced In-Vehicle Information and Communication Systems, Version 2.0,” Alliance of Automotive Manufacturers, 2006.
- Mehler, B., Reimer, B., Dobres, J., McAnulty, H., Mehler, A., Munger, D., and Coughlin, J.F., “Further Evaluation of the Effects of a Production Level “Voice-Command” Interface on Driver Behavior: Replication and a Consideration of the Significance of Training Method,” MIT AgeLab Technical Report No. 2014-2,” Massachusetts Institute of Technology, Cambridge, MA, 2014.
- Mehler, B., Reimer, B., and Dusek, J.A., “MIT AgeLab Delayed Digit Recall Task (N-Back),” MIT AgeLab White Paper Number 2011-3B. Massachusetts Institute of Technology, Cambridge, MA, 2011.
- Mehler, B., Reimer, B., and Coughlin, J.F., “Sensitivity of Physiological Measures for Detecting Systematic Variations in Cognitive Demand from a Working Memory Task: An On-Road Study Across Three Age Groups,” Human Factors 54(3): 396-412, 2012.
- Reimer, B., Mehler, B., McAnulty, H., Munger, D., Mehler, A., Perez, E.A.G, Manhardt, T., and Coughlin, J.F., “ A Preliminary Assessment of Perceived and Objectively Scaled Workload of a Voice-Based Driver Interface,” Proceedings of the 7th International Driving Symposium on Human Factors in Driver Assessment, Training, and Vehicle Design, Bolton Landing, New York, June 18-19, 2013, pp.537-543.
- Mehler, B., Kidd, D., Reimer, B., Reagan, I., Dobres, J., and McCartt, A., “Multi-Modal Assessment of On-Road Demand of Voice and Manual Phone Calling and Voice Navigation Entry Across Two Embedded Vehicle Systems,” Ergonomics, 2015, doi:10.1080/00140139.2015.1081412
- ISO 15007-1, “Road Vehicles - Measurement of Driver Visual Behaviour with Respect to Transport Information and Control Systems - Part 1: Definitions and Parameters,” Geneva, Switzerland: International Standards Organization, 2002.
- ISO 15007-2, “Road Vehicles - Measurement of Driver Visual Behaviour with Respect to Transport Information and Control Systems - Part 2: Equipment and Procedures,” Geneva, Switzerland: International Standards Organization, 2001.
- Reimer, B., Gruevski, P., and Coughlin, J.F., “MIT AgeLab Video Annotator,” Cambridge, MA, 2014, https://bitbucket.org/agelab/annotator
- Smith, D.L., Chang, J., Glassco, R., Foley, J., and Cohen, D., “Methodology for Capturing Driver Eye Glance Behavior During In-Vehicle Secondary Tasks,” Transportation Research Record: Journal of the Transportation Research Board 1937(1): 61-65, 2005.
- Task Force of the European Society of Cardiology and the North American Society of Pacing and Electrophysiology, “Heart Rate Variability: Standards of Measurement, Physiological Interpretation, and Clinical Use. European Heart Journal 17: 354-381, 1996.
- Reimer, B., and Mehler, B., “The Impact of Cognitive Workload on Physiological Arousal in Young Adult Drivers: A Field Study and Simulation Validation,” Ergonomics 54(10): 932- 942, 2011.
- Team R Core, “R: A Language and Environment for Statistical Computing,” Vienna, Austria: R Foundation for Statistical Computing, 2013. Retrieved from http://www.R-project.org/
- Conover, W. J., and Iman, R. L., “Rank Transformations as a Bridge between Parametric and Nonparametric Statistics,” American Statistician 35(3): 124-129, 1981.
- Friedman, M, “The Use of Ranks to Avoid the Assumption of Normality Implicit in the Analysis of Variance,” Journal of the American Statistical Association 32(200): 675-701, 1937.
- Östlund, J., Peters, B., Thorslund, B., Engström, J., Markkula, G., Keinath, A., Horst, D., Juch, S., Mattes, S., and Foehl, U., “Adaptive Integrated Driver-Vehicle Interface (AIDE): Driving Performance Assessment - Methods and Metrics (Report No. IST-1-507674-IP),” Information Society Technologies (IST) Programme, Gothenburg, Sweden, 2005.
- SAE International Surface Vehicle Recommended Practice, “Operational Definitions of Driving Performance Measures and Statistics,” SAE Standard J2944, Iss. Jun. 2015.
- McWilliams, T., Reimer, B., Mehler, B., Dobres, J., and McAnulty, H., “A Secondary Assessment of the Impact of Voice Interface Turn Delays on Driver Attention and Arousal in Field Conditions: A Consideration of 4 Vehicle Systems and a Smartphone,” Proceedings of the 8th International Driving Symposium on Human Factors in Driver Assessment, Training, and Vehicle Design, Salt Lake City, Utah, June 22-25, 2015.
- Mehler, B., Reimer, B., Dobres, J., McAnulty, H., and Coughlin, J.F., “Assessing the Demands of Voice Based In-Vehicle Interfaces. Phase II Experiment 1 - 2014 Chevrolet Impala (Study Code 2014b),” MIT AgeLab Technical Report 2015-6, Massachusetts Institute of Technology, Cambridge, MA, 2015.