This content is not included in
your SAE MOBILUS subscription, or you are not logged in.
Driver Visual Focus of Attention Estimation in Autonomous Vehicles
Technical Paper
2020-01-1037
ISSN: 0148-7191, e-ISSN: 2688-3627
Annotation ability available
Sector:
Language:
English
Abstract
An existing challenge in current state-of-the-art autonomous vehicles is the process of safely transferring control from autonomous driving mode to manual mode because the driver may be distracted with secondary tasks. Such distractions may impair a driver’s situational awareness of the driving environment which will lead to fatal outcomes during a handover. Current state-of-the-art vehicles notify a user of an imminent handover via auditory, visual, and physical alerts but are unable to improve a driver’s situational awareness before a handover is executed. The overall goal of our research team is to address the challenge of providing a driver with relevant information to regain situational awareness of the driving task. In this paper, we introduce a novel approach to estimating a driver’s visual focus of attention using a 2D RGB camera as input to a Multi-Input Convolutional Neural Network with shared weights. The system was validated in a realistic driving scenario. The developed approach is a first step towards estimating a driver’s situational awareness from their observable indicators which will in the future be utilized to provide targeted information to the driver during a handover.
Recommended Content
Authors
Citation
Hijaz, A., Louie, W., Bellafaire, M., Rawashdeh, O. et al., "Driver Visual Focus of Attention Estimation in Autonomous Vehicles," SAE Technical Paper 2020-01-1037, 2020, https://doi.org/10.4271/2020-01-1037.Also In
References
- U.S. Department of Transportation 2019
- de CF , W J. , Happee , R. , Martens , M.H. , and Stanton , N.A. Effects of Adaptive Cruise Control and Highly Automated Driving on Workload and Situation Awareness:A Review of The Empirical Evidence Transportation Research Part F: Traffic Psychology and Behaviour 27 196 217 2014
- Casner , S.M. , Hutchins , E.L. , and Norman , D. The Challenges of Partially Automated Driving Communications of the ACM 59 5 70 77 2016
- Uhlemann , E. Continued Dispute on Preferred Vehicle-to-Vehicle Technologies [Connected Vehicles] IEEE Vehicular Technology Magazine 12 3 17 20 2017
- Walch , M. , Lange , K. , Baumann , M. , and Weber , M. Autonomous Driving: Investigating The Feasibility of Car-Driver Handover Assistance Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications 11 18 2015
- van der Heiden , R. , Iqbal , S.T. , and Janssen , C.P. Priming Drivers before Handover in Semi-Autonomous Cars Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems 392 404 2017
- Hijaz , A. , Louie , G. and Mansour , I. Towards a Driver Monitoring System for Estimating Driver Situational Awareness IEEE International Conference on Robot Human Interactive Communication 2019
- Endsley , M.R. and Garland , D.J. Situation Awareness Analysis and Measurement First CRC Press 2000 3 6 https://doi.org/10.1201/b12461
- Jones , D.G. and Endsley , M.R. Sources of Situation Awareness Errors in Aviation Aviation Space and Environmental Medicine 67 6 507 512 1996
- Lim , J. , Amado , A. , Sheehan , L. , and Van Emmerik , R.E.A. Dual Task Interference During Walking: The Effects of Texting on Situational Awareness and Gait Stability Gait & Posture 42 4 466 471 2015
- Merwe , D.V. , Koen , H.V.D. , and Zon , R. Eye Movements as an Indicator of Situation Awareness in a Flight Simulator Experiment The International Journal of Aviation Psychology 22 1 78 95 2012
- Just , M.A. and Carpenter , P.A. Eye Fixations and Cognitive Processes Cognitive Psychology 8 4 441 480 1976
- Ruth , J.S. and Giambra , L.M. Eyemovements as a Function of Attention and Rate of Change in thought Content Perceptual and Motor Skills 39 1 475 480 1974
- Fridman , L. , Langhans , P. , Lee , J. , and Reimer , B. Driver Gaze Region Estimation Without Use of Eye Movement IEEE Intelligent Systems 31 3 49 56 2016
- Tawari , A. , and Trivedi , M.M. Robust and Continuous Estimation of Driver Gaze Zone by Dynamic Analysis of Multiple Face Videos 2014 IEEE Intelligent Vehicles Symposium Proceedings 344 349 2014
- Curcio , C.A. and Allen , K.A. Topography of Ganglion Cells in Human Retina Journal of Comparative Neurology 300 1 5 25 1990
- Vicente , F. , Huang , Z. , Xiong , X. , la Torre , F.D. , Zhang , W. , and Levi , D. Driver Gaze Tracking and Eyes Off the Road Detection System IEEE Transactions on Intelligent Transportation Systems 16 4 2014 2027 2015
- Liu , T. , Yang , Y. , Huang , G.-B. , Yeo , Y.K. , and Lin , Z. Driver Distraction Detection Using Semi-Supervised Machine Learning IEEE Transactions on Intelligent Transportation Systems 17 4 1108 1120 2015
- Huang , G.-B. , Zhu , Q.-Y. , and Siew , C.-K. Extreme Learning Machine: Theory and Applications Neurocomputing 70 1-3 489 501 2006
- Craye , C. and Karray , F. 2015
- Curcio , C.A. and Allen , K.A. Topography of Ganglion Cells in Human Retina The Journal of Comparative Neurology 300 1 5 25 1990
- Krafka , K. , Khosla , A. , Kellnhofer , P. , Kannan , H. , Bhandarkar , S. , Matusik , W. , and Torralba , A. Eye Tracking for Everyone Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2016 2176 2184