This content is not included in
your SAE MOBILUS subscription, or you are not logged in.
Early Detection of Reduced Alertness using Subsidiary Behavior
Technical Paper
2012-01-0737
ISSN: 0148-7191, e-ISSN: 2688-3627
Annotation ability available
Sector:
Language:
English
Abstract
An analysis of drivers' facial expressions and subsidiary behavior events (e.g., yawning, self-touching hand motions, etc.) revealed a significant correlation between the struggle against sleepiness and the frequency of occurrence of such events. We counted drivers' subsidiary behavior events by video analysis and defined nine categories of events related to the mouth, hands, head, shoulders, body and eyes. Mouth-related events were further categorized as yawning, stifling a yawn, exhaling and deep breathing. Yawning and self-touching hand motions in particular were observed in relatively large numbers among subsidiary behavior events. Based on this observation, we created an algorithm for detecting yawning and self-touching hand motions using a monocular camera and calculated the frequency of these subsidiary behavior events. In experiments, we compared the frequency of the subsidiary behavior events at the outset of driving and after the passage of time. As a result, we found time frames with a higher frequency of subsidiary events than at the outset, indicating an imminent decline in alertness based on a comparison with drivers' facial expressions. Our results show that the proposed method can detect a decrease in alertness earlier than the conventional eye closure rate method.
Recommended Content
Technical Paper | Postural Behaviour in Static Gazing Sidewards |
Technical Paper | Tuning - A Structured Approach |
Ground Vehicle Standard | Direction-of-Motion Stereotypes for Automotive Hand Controls |
Topic
Citation
Matsuo, H. and Khiat, A., "Early Detection of Reduced Alertness using Subsidiary Behavior," SAE Technical Paper 2012-01-0737, 2012, https://doi.org/10.4271/2012-01-0737.Also In
References
- Honda, K. The Science and Application of Sleep: Research and Development of Sleep Sensing Techniques for Securing Quality Sleep Tokyo CMC Publishing 2008 331
- Kitajima, Y. Numata, N. Yamamoto, K. Goi, Y. “A Study of a Method for Predicting Driver Drowsiness (I): Method of Assessing Drowsiness Data and Effective Index for Predicting Changes in Drowsiness,” Transactions of Japan Society of Mechanical Engineers 63 613 Sept. 1997 93 100 1997
- Ishida, K. Ito, M. Kimura, T. “A Study of Factors Expressing Drowsiness Data Features based on Observation and Analysis of Facial Expressions,” Preprints of JSAE Autumn Scientific Lecture Series, No. 135-07 2007
- Osuga, M. Kamakura, Y. Inoue, Y. Noguchi, Y. “Estimation of Driver State of Alertness (I): Facial Expression Assessment and Physiological Indexes,” Preprints of JSAE Spring Scientific Lecture Series, No. 51-08 2008
- Ueda, M. Kondo, M. Matsumoto, H. Hayakawa, K. Tanaka, R. “A Study concerning Quantification of Driver Fatigue based on Mental/Physiological Reactions during Vehicle-following Driving.” Transactions of the Japan Society of Civil Engineers 22 22-0805 805 814 2005
- Kanakura, T. Inamoto, T. Hagiwara, H. “Relationship Between Alertness and Body Motions using Alpha-waves as a Physiological Index,” Japanese Society for Medical and Biological Engineering 48 1 93 97 2010
- Tada, E. Fukuda, K. Yamada, F. Psychology of Blinking: Summary of Studies on Blinking Behavior Kyoto Kitaoji Shobo 1991 302
- Fukui, K. “Method of Evaluating Decline in Steering Ability during Continuous Driving,” R&D Review of Toyota Central Labs., Inc. 30 3 57 65 1995
- Ito, M. Suzuki, I. Inagaki, T. Yoshimura, K. “Detection of Drivers' Subsidiary Behavior based on Body Pressure Sensor Data,” Traffic Science Research Paper No. 48 61 64 2007
- Kishida, T. Monotonous Work and Subsidiary Behavior Tokyo Kobundo Publishing Co. 1982 225
- Hirose, F. Nagasaki, A. “A Study of the Possibility of Judging Alertness Levels using Subsidiary Behavior, Research Report 02004 of Central Research Institute of Electric Power Industry,” Tokyo Central Research Institute of Electric Power Industry 2003 34
- Nopsuwanchai, Roongroj Noguchi, Yoshihiro Ohsuga, Mieko Kamakura, Yoshiyuki Inoue, Yumiko “Driver-Independent Assessment of Arousal States from Video Sequences Based on the Classification of Eyeblink Patterns” Proceedings of the 11th International IEEE, Conference on Intelligent Transportation Systems 917 924 2008
- Hiroshi, Ueno Kaneda, Masayuki Tsukino, Masataka “Development of Drowsiness Detection System” Vehicle Navigation and Information Systems Conference, 1994. Proceedings 15 20 1994
- Khiat, A. Matsuo, H. “Monitoring Changes in Human Behavior Dynamics during Monotonous Driving Conditions for Driver State Estimation” Poster in International Summer School on Computer Vision (ICVSS2010) Sicily, Italy July 2010
- Wiskott, Laurenz Fellous, Jean-Marc Kruger, Norbert von der Malsburg, Christoph “Face Recognition by Elastic Bunch Graph Matching” Intelligent Biometric Techniques in Fingerprint and Face Recognition 355 396 1999