Camera-Based Driver Monitoring for Increased Safety and Convenience

This paper discusses an interior camera system, monitoring the driver's state, to extend the comfort as well as the safety of future vehicles. The system consists of a CMOS-based camera, illumination units in the near infrared spectrum, and a control unit. The software is able to measure head position and orientation and thereby calculates the field of view of the driver. In addition, it measures the driver's eyelid opening and is able to detect micro-sleep events and to estimate the driver's state of vigilance. While detection of drowsiness and distraction are safety related issues, the system is also able to enhance the convenience of the vehicle. Head position and orientation are used to automatically adjust the headrest and to dynamically adjust the mirrors to ensure an optimal view for the driver. A face recognition module is used to identify the driver and to adjust the vehicle automatically to his personal needs and desires including the seat position, climate control, and infotainment unit.