This content is not included in
your SAE MOBILUS subscription, or you are not logged in.
The Detection of Visual Distraction using Vehicle and Driver-Based Sensors
Technical Paper
2016-01-0114
ISSN: 0148-7191, e-ISSN: 2688-3627
Annotation ability available
Sector:
Language:
English
Abstract
Distracted driving remains a serious risk to motorists in the US and worldwide. Over 3,000 people were killed in 2013 in the US because of distracted driving; and over 420,000 people were injured. A system that can accurately detect distracted driving would potentially be able to alert drivers, bringing their attention back to the primary driving task and potentially saving lives. This paper documents an effort to develop an algorithm that can detect visual distraction using vehicle-based sensor signals such as steering wheel inputs and lane position. Additionally, the vehicle-based algorithm is compared with a version that includes driving-based signals in the form of head tracking data. The algorithms were developed using machine learning techniques and combine a Random Forest model for instantaneous detection with a Hidden Markov model for time series predictions. The AttenD distraction algorithm, based on eye gaze location, was utilized to generate the ground truth for the algorithm development. The data collection at the National Advanced Driving Simulator is summarized, results are presented, and the paper concludes with discussion on the algorithms. This work falls within a program of research on Driver Monitoring of Inattention and Impairment Using Vehicle Equipment (DrIIVE) and is sponsored by NHTSA.
Recommended Content
Authors
Citation
Schwarz, C., Brown, T., Lee, J., Gaspar, J. et al., "The Detection of Visual Distraction using Vehicle and Driver-Based Sensors," SAE Technical Paper 2016-01-0114, 2016, https://doi.org/10.4271/2016-01-0114.Also In
References
- NHTSA Distracted Driving 2013 NHTSA Washington, D.C. Research Note DOT HS 812 132 Apr. 2015
- Bergasa L. M. , Nuevo J. , Sotelo M. A. , Barea R. , and Lopez M. E. Real-time system for monitoring driver vigilance IEEE Trans. Intell. Transp. Syst. 7 1 63 77 Mar. 2006
- Jiménez P. , Bergasa L. M. , Nuevo J. , Hernández N. , and Daza I. G. Gaze Fixation System for the Evaluation of Driver Distractions Induced by IVIS IEEE Trans. Intell. Transp. Syst. 13 3 1167 1178 2012
- Busso C. and Jain J. Advances in Multimodal Tracking of Driver Distraction Digital Signal Processing for In-Vehicle Systems and Safety New York, NY Springer New York 2012 253 270
- Lee J. D. , Roberts S. C. , Hoffman J. D. , and Angell L. S. Scrolling and Driving How an MP3 Player and Its Aftermarket Controller Affect Driving Performance and Visual Behavior Hum. Factors J. Hum. Factors Ergon. Soc. 54 2 250 263 Apr. 2012
- Liang Y. , Reyes M. L. , and Lee J. D. Real-Time Detection of Driver Cognitive Distraction Using Support Vector Machines IEEE Trans. Intell. Transp. Syst. 8 2 340 350 Jun. 2007
- Dong Y. , Hu Z. , Uchimura K. , and Murayama N. Driver Inattention Monitoring System for Intelligent Vehicles: A Review IEEE Trans. Intell. Transp. Syst. 12 2 596 614 Jun. 2011
- Cai H. and Lin Y. Modeling of operators’ emotion and task performance in a virtual driving environment Int. J. Hum.-Comput. Stud. 69 9 571 586 Aug. 2011
- Mehler B. , Reimer B. , and Coughlin J. F. Sensitivity of Physiological Measures for Detecting Systematic Variations in Cognitive Demand From a Working Memory Task An On-Road Study Across Three Age Groups Hum. Factors J. Hum. Factors Ergon. Soc. 54 3 396 412 Jun. 2012
- D’Orazio T. , Leo M. , Guaragnella C. , and Distante A. A visual approach for driver inattention detection Pattern Recognit. 40 8 2341 2355 Aug. 2007
- Huang Q. , Fan Y. , and Lei T. A novel approach of eye movement and Expression 2010 2nd International Conference on Future Computer and Communication (ICFCC) 2010 3 V3-436 V3-440
- Jo J. , Lee S. J. , Jung H. G. , Park K. R. , and Kim J. Vision-based method for detecting driver drowsiness and distraction in driver monitoring system Opt. Eng. 50 12 127202 127202-24 2011
- Ahlstrom C. , Victor T. , Wege C. , and Steinmetz E. Processing of Eye/Head-Tracking Data in Large-Scale Naturalistic Driving Data Sets IEEE Trans. Intell. Transp. Syst. 13 2 553 564 Jun. 2012
- Fu X. , Guan X. , Peli E. , Liu H. , and Luo G. Automatic Calibration Method for Driver’s Head Orientation in Natural Driving Environment IEEE Trans. Intell. Transp. Syst. 14 1 303 312 Mar. 2013
- Ostlund J. , Peters B. , Thorslund B. , Engstrom J. , Markkula G. , Keinath A. , Horst D. , Juch S. , Mattes S. , and Foehl U. Driving Performance Assessment - Methods and Metrics Information Society Technologies, Final Report IST-1-507674-IP Mar. 2004
- Greenberg J. , Tijerina L. , Curry R. , Artz B. , Cathey L. , Kochhar D. , Kozak K. , Blommer M. , and Grant P. Driver Distraction: Evaluation with Event Detection Paradigm Transp. Res. Rec. J. Transp. Res. Board 1843 1 9 Jan. 2003
- Kaber D. B. , Liang Y. , Zhang Y. , Rogers M. L. , and Gangakhedkar S. Driver performance effects of simultaneous visual and cognitive distraction and adaptation behavior Transp. Res. Part F Traffic Psychol. Behav. 15 5 491 501 Sep. 2012
- Liang Y. and Lee J. D. A hybrid Bayesian Network approach to detect driver cognitive distraction Transp. Res. Part C Emerg. Technol. 38 146 155 Jan. 2014
- Regan M. A. , Lee J. D. , and Young , Kristie Driver Distraction: Theory, Effects, and Mitigation CRC Press 2008
- Sathyanarayana A. , Boyraz P. , and Hansen J. H. L. Information fusion for robust ‘context and driver aware’ active vehicle safety systems Inf. Fusion 12 4 293 303 Oct. 2011
- Aoude G. S. , Desaraju V. R. , Stephens L. H. , and How J. P. Driver Behavior Classification at Intersections and Validation on Large Naturalistic Data Set IEEE Trans. Intell. Transp. Syst. 13 2 724 736 Jun. 2012
- Ersal T. , Fuller H. J. A. , Tsimhoni O. , Stein J. L. , and Fathy H. K. Model-Based Analysis and Classification of Driver Distraction Under Secondary Tasks IEEE Trans. Intell. Transp. Syst. 11 3 692 701 Sep. 2010
- NHTSA Visual-Manual NHTSA Driver Distraction Guidelines for In-Vehicle Electronic Devices NHTSA Washington, D.C. NHTSA Guidelines NHTSA-2010-0053 Apr. 2013
- Dingus T. A. , Klauer S. G. , Neale V. L. , Petersen A. , Lee S. E. , Sudweeks J. D. , Perez M. A. , Hankey J. , Ramsey D. J. , Gupta S. , Bucher C. , Doerzaph Z. R. , Jermeland J. , and Knipling R. R. The 100-Car Naturalistic Driving Study, Phase II -Results of the 100-Car Field Experiment Apr. 2006
- Klauer S. G. , Dingus T. A. , Neale V. L. , Sudweeks J. D. , and Ramsey D. J. The Impact of Driver Inattention on Near-Crash/Crash Risk: An Analysis Using the 100-Car Naturalistic Driving Study Data USDOT Washington, DC Final Report DOT HS 810 594 Apr. 2006
- Victor T. , Dozza M. , Bärgman J. , Boda C.-N. , Engström J. , Flannagan C. , Lee J. D. , and Markkula G. Analysis of Naturalistic Driving Study Data: Safer Glances, Driver Inattention, and Crash Risk Final Report S2-S08A-RW-1 2015
- Yeo M. V. M. , Li X. , Shen K. , and Wilder-Smith E. P. V. Can SVM be used for automatic EEG detection of drowsiness during car driving? Saf. Sci. 47 1 115 124 Jan. 2009
- Wang J. , Xu W. , and Gong Y. Real-time driving danger-level prediction Eng. Appl. Artif. Intell. 23 8 1247 1254 Dec. 2010
- Wollmer M. , Blaschke C. , Schindl T. , Schuller B. , Farber B. , Mayer S. , and Trefflich B. Online Driver Distraction Detection Using Long Short-Term Memory IEEE Trans. Intell. Transp. Syst. 12 2 574 582 Jun. 2011
- Yang X.-S. and Deb S. Engineering optimisation by cuckoo search Int. J. Math. Model. Numer. Optim. 1 4 330 343 Jan. 2010
- Veeraraghavan H. , Bird N. , Atev S. , and Papanikolopoulos N. Classifiers for driver activity monitoring Transp. Res. Part C Emerg. Technol. 15 1 51 67 Feb. 2007
- Breiman L. Random Forests Mach. Learn. 45 1 5 32 Oct. 2001
- Lee B.-G. and Chung W.-Y. Driver Alertness Monitoring Using Fusion of Facial Features and Bio-Signals IEEE Sens. J. 12 7 2416 2422 Jul. 2012
- Lansdown T. C. , Brook-Carter N. , and Kersloot T. Distraction from multiple in-vehicle secondary tasks: vehicle performance and mental workload implications Ergonomics 47 1 91 104 Jan. 2004
- Chisholm S. L. , Caird J. K. , Lockhart J. , Fern L. , and Teteris E. Driving Performance while Engaged in MP-3 Player Interaction: Effects of Practice and Task Difficulty on PRT and Eye Movements Driving Assessment 2007: 4th International Driving Symposium on Human Factors in Driver Assessment, Training, and Vehicle Design 2007
- Blanco M. , Biever W. J. , Gallagher J. P. , and Dingus T. A. The impact of secondary task cognitive processing demand on driving performance Accid. Anal. Prev. 38 5 895 906 Sep. 2006
- Jamson A. Hamish and Merat N. Surrogate in-vehicle information systems and driver behaviour: Effects of visual and cognitive load in simulated rural driving Transp. Res. Part F Traffic Psychol. Behav. 8 2 79 96 Mar. 2005
- Lee J. D. , Fiorentino D. , Reyes M. L. , Brown T. L. , Ahmad O. , Fell J. , Ward N. , and Dufour R. Assessing the Feasibility of Vehicle-Based Sensors to Detect Alcohol Impairment Aug. 2010
- Lee J. D. , Moeckli J. , Brown T. , and Roberts S. Detection of Driver Distraction using Vision Based Algorithms Proceedings of the 23rd Enhanced Safety of Vehicles Conference 2013
- Lee J. D. , Moeckli J. , Brown T. L. , Roberts S. C. , Schwarz C. , Yekhshatyan L. , Nadler E. , Liang Y. , Victor T. , Marshall D. , and Davis C. Distraction Detection and Mitigation Through Driver Feedback Final Report DOT HS 811 547A May 2013
- Lee J. D. , Moeckli J. , Brown T. L. , Roberts S. C. , Schwarz C. , Yekhshatyan L. , Nadler E. , Liang Y. , Victor T. , Marshall D. , and Davis C. Distraction Detection and Mitigation Through Driver Feedback: Appendices Final Report DOT HS 811 547B May 2013
- Brown T. , Lee J. , Schwarz C. , Fiorentino D. , and McDonald A. Assessing the Feasibility of Vehicle-based Sensors to Detect Drowsy Driving NHTSA Washington, DC Final Report DOT HS 811 886 Feb. 2014
- Roberts S. C. , Ghazizadeh M. , and Lee J. D. Warn me now or inform me later: Drivers’ acceptance of real-time and post-drive distraction mitigation systems Int. J. Hum.-Comput. Stud. 70 12 967 979 Dec. 2012
- McDonald A. D. , Lee J. D. , Schwarz C. , and Brown T. L. Steering in a Random Forest Ensemble Learning for Detecting Drowsiness-Related Lane Departures Hum. Factors J. Hum. Factors Ergon. Soc. 56 5 986 998 Aug. 2014
- Schwarz C. , Brown T. L. , Gaspar J. , Marshall D. , Lee J. , Kitazaki S. , and Kang J. Mitigating Drowsiness: Linking Detection to Mitigation Proceedings of the 24th ESV Conference Gothenburg, Sweden 2015
- McDonald A. D. , Schwarz C. W. , Lee J. D. , and Brown T. L. Impairment as a hidden state: How Hidden Markov Models improve drowsiness detection and may differentiate between distraction, drowsiness, and alcohol impairment Proceedings of the TRB 93rd Annual Meeting Washington, DC 2014
- Driver Focus-Telematics Working Group Statement of Principles, Criteria and Verification Procedures on Driver Interactions with Advanced In-Vehicle Information and Communication Systems Auto Alliance Jun 2006
- Eskandarian A. , Sayed R. , Delaigue P. , Blum J. , and Mortazavi A. Advanced Driver Fatigue Research FMCSA Washington, DC Final Report FMCSA-RRR-07-001 Apr. 2007
- LaViola J. J. Double exponential smoothing: an alternative to Kalman filter-based predictive tracking Proceedings of the workshop on Virtual environments 2003 New York, NY, USA 2003 199 206
- Dingus T. A. , Hulse M. C. , Antin J. F. , and Wierwille W. W. Attentional demand requirements of an automobile moving-map navigation system Transp. Res. Part Gen. 23 4 301 315 Jul. 1989
- Kircher K. and Ahlstrom C. Issues related to the driver distraction detection algorithm AttenD Swedish National Road and Transport Resear ch Institute (VTI) Final Report 2009
- R Development Core Team R: A language and environment for statistical computing Vienna, Austria R Foundation for Statistical Computing 2009
- Kuhn M. Building Predictive Models in R Using the caret Package J. Stat. Softw. 28 5 Nov 2008
- O’Connell J. and Højsgaard S. Hidden Semi Markov Models for Multiple Observation Sequences: The mhsmm Package for R J. Stat. Softw. 39 i04
- Robin X. , Turck N. , Hainard A. , Tiberti N. , Lisacek F. , Sanchez J.-C. , and Müller M. pROC: an open-source package for R and S+ to analyze and compare ROC curves BMC Bioinformatics 12 1 77 Mar. 2011
- Wallis S. Binomial Confidence Intervals and Contingency Tests: Mathematical Fundamentals and the Evaluation of Alternative Methods J. Quant. Linguist. 20 3 178 208 2013
- Wilson E. Probable Inference, the Law of Succession, and Statistical Inference J. Am. Stat. Assoc. 22 158 209 212 1927
- Brown T. , Gaspar J. , Schwarz C. , Schmitt R. , and Marshall D. DrIIVE Track B: Assess Potential Countermeasures for Drowsy Driving Lane Departures National Advanced Driving Simulator Iowa City, IA Technical Report N2015-007 Sep. 2015
- Brown T. , Schwarz C. , Lee J. , Gaspar J. , Marshall D. , and Ahmad O. DrIIVE Track A: Develop and Evaluate a System of Algorithms to Identify Signatures of Alcohol-Impaired, Drowsy and Distracted Driving National Advanced Driving Simulator Iowa City, IA Technical Report N2015-009 Sep. 2015