This content is not included in your SAE MOBILUS subscription, or you are not logged in.
Towards Standardized Performance Evaluation of Camera-Based Driver State Sensing Technologies
ISSN: 0148-7191, e-ISSN: 2688-3627
Published April 05, 2016 by SAE International in United States
Annotation ability available
Driver state sensing technologies start to be widely used in vehicular systems developed from different manufacturers. To optimize the cost and minimize the intrusiveness towards driving, majority of these systems rely on in-cabin camera(s) and other optical sensors. With their great capabilities of detecting and intervening driver distraction and inattention, these technologies might become key components in future vehicle safety and control systems. However, currently there are no common standards available to compare the performance of these technologies, thus it is necessary to develop one standardized process for the evaluation purpose. In this paper, we propose one standardized systematic evaluation process after successfully addressing three difficulties: (1) defining and selecting the important influential individual and environmental factors, (2) countering the effects of individual differences and randomness in driver behaviors, and (3) building a reliable in-vehicle driver head motion tracking tool to collect ground-truth motion data. We have completed one large-scale data collection towards a commercial driver state-sensing platform. For each subject, 30 to 40 minutes of head motion data were collected covering one full factorial design of variables of lighting conditions, head/face features, and camera locations. The collected data were analyzed based on a proposed performance measure. The whole process can not only efficiently evaluate individual camera-based driver state sensing products, but also builds one common base for comparing performance of different systems.
CitationTian, R., Ruan, K., Li, L., Le, J. et al., "Towards Standardized Performance Evaluation of Camera-Based Driver State Sensing Technologies," SAE Technical Paper 2016-01-1500, 2016, https://doi.org/10.4271/2016-01-1500.
- Yekhshatyan L. , and Lee J. D. Changes in the correlation between eye and steering movements indicate driver distraction IEEE Transactions on Intelligent Transportation Systems 14 1 136 145 March 2013
- Tian R. , Li L. , Chen M. , Chen Y. , and Witt G. J. Studying the effects of driver distraction and traffic density on the probability of crash and near-crash events in naturalistic driving environment IEEE Transactions on Intelligent Transportation Systems 14 3 1547 1555 September 2013
- Oyini Mbouna R. , Kong S. G. , and Myung-Geun C. Visual analysis of eye state and head pose for driver alertness monitoring IEEE Transactions on Intelligent Transportation Systems 14 3 1462 1469 September 2013
- Tawari A. , Martin S. , and Trivedi M. M. Continuous head movement estimator for driver assistance: Issues, algorithms, and on-road evaluations IEEE Transactions on Intelligent Transportation Systems 15 2 818 830 April 2014
- Fu X. , Guan X. , Peli E. , Liu H. , and Luo G. Automatic calibration method for driver’s head orientation in natural driving environment IEEE Transactions on Intelligent Transportation Systems 14 1 303 312 March 2013
- Vicente F. , Huang Z. , Xiong X. , De la Torre F. , Zhang W. , and Levi D. Driver gaze tracking and eyes off the road detection system IEEE Transactions on Intelligent Transportation Systems 16 4 2014 2027 August 2015
- Nekoui M. , Ni D. , Pishro-Nik H. , Prasad R. , Kanjee M. R. , Zhu H. and Nguyen T. Development of a VII-enabled prototype intersection collision warning system 5th International Conference on Testbeds and Research Infrastructures for the Development of Networks & Communities and Workshops 1 8 April 2009
- Lin J.-R. , Talty T. , and Tonguz O. K. A blind zone alert system based on intra-vehicular wireless sensor networks IEEE Transactions on Industrial Informatics 11 2 476 484 April 2015
- Wijayasinghe I. B. , Aulisa E. , Büttner U. , Ghosh B. K. , Glasauer S. , and Kremmyda O. Potential and optimal target fixating control of the human head/eye complex IEEE Transactions on Control Systems Technology 23 2 796 804 March 2015
- Bill Fleming New Technologies for Automotive Electronics IEEE Vehicular Technology Magazine 7 4 4 12 December 2012