This content is not included in your SAE MOBILUS subscription, or you are not logged in.
Securing Camera Based Active Driver Monitoring System from Video Forgery Attacks Using Deep Learning
ISSN: 0148-7191, e-ISSN: 2688-3627
Published March 29, 2022 by SAE International in United States
Annotation ability available
The numerous superiorities of autonomous vehicles in terms of safety, driving experience, and comfort against the traditional driving favor them in the wide adoption across the modern automotive sector. Driver Monitoring System (DMS) is one of the high Automotive Safety Integrity Level (ASIL) specified driver assistance functionalities, which assists the driver continuously as a part of Active Safety system. The fused vision-related functionalities of the camera based active DMS such as Distraction, Drowsiness, and Emotion detection systems monitors the driver’s In-vehicle Activities, Eye movements, and Facial expressions respectively to awake the driver with constant alerts under undesired conditions to achieve a right driving attention. The presence of the modern day DMS in the In-Vehicle-Infotainment Digital Cockpits exposes the critical DMS into a wide range of cyber-attacks either locally or remotely, which in turn causes the malfunctioning of the active safety driver assistance system. This malfunctioning is due to integrity compromisations through cyberattacks, where attackers forge the incoming driver video data on the compromised infotainment system, which has external world connectivity. The tampering of incoming video content which contains driver activities, eye movements, and facial expressions at pixel level, block level or scene results in false interpretation by the distraction, drowsiness, and emotion detection modules of DMS respectively. The false interpretation of the driver states by camera based behavioral active DMS causes numerous false positive and false negative driver alerts due to cyber-attacks, which are undesired. Hence, here a deep learning based digital forensic approach is proposed to detect the forgery attacks on the DMS. The attacker’s successful launch of forgery attacks on the driver monitoring video information is detected intelligently using deep learning techniques before passing the video input for DMS modules such as Distraction, Drowsiness, and Emotion detection. The proposed approach involves the detection of splicing and copy-move object forgery attacks on the front camera feeds of the DMS in real-time using convolutional neural networks. The proposed system is responsible for validating the authenticity of the incoming real-time camera video frames prior to Distraction, Drowsiness, and Emotion detections and generating alerts. Hence, the proposed system successfully detects the video forgery attacks, and provides only the authentic driver monitoring alerts by enhancing the trust on driver monitoring systems from cyber-attacks by ensuring the safety and system integrity.
CitationK. Y., P., Ujjini Matad, R., and S M, S., "Securing Camera Based Active Driver Monitoring System from Video Forgery Attacks Using Deep Learning," SAE Technical Paper 2022-01-0115, 2022, https://doi.org/10.4271/2022-01-0115.
- Euro NCAP https://cdn.euroncap.com/media/30700/euroncap-roadmap-2025-v4.pdf
- Sikander G. and Anwar S. Driver Fatigue Detection Systems: A Review IEEE Transactions on Intelligent Transportation Systems 20 6 2339 2352 2019 10.1109/TITS.2018.2868499
- Ngxande M. , Tapamo J. and Burke M. Driver Drowsiness Detection Using Behavioral Measures and Machine Learning Techniques: A Review of State-Of-Art Techniques 2017 Pattern Recognition Association of South Africa and Robotics and Mechatronics (PRASA-RobMech) 2017 156 161 10.1109/RoboMech.2017.8261140
- Kashevnik , A. , Shchedrin , R. , Kaiser , C. , and Stocker , A. Driver Distraction Detection Methods: A Literature Review and Framework IEEE Access 9 2021 60063 60076 10.1109/ACCESS.2021.3073599
- Dibaei , Mahdi , Zheng , Xi , Jiang , Kun , Maric , Sasa , et al. 2019
- Mazloom , S. et al. A Security Analysis of an In-Vehicle Infotainment and App Platform WOOT 2016
- Dadam , S.R. , Zhu , D. , Kumar , V. , Ravi , V. Palukuru V.S.S. Onboard Cybersecurity Diagnostic System for Connected Vehicles SAE Technical Paper 2021-01-1249 2021 https://doi.org/10.4271/2021-01-1249
- Johnston , P. and Elyan , E. A Review of Digital Video Tampering: from Simple Editing to Full Synthesis Digital Investigation [online] 29 2019 67 81 https://doi.org/10.1016/j.diin.2019.03.006
- Singh , R.D. and Aggarwal , N. Video Content Authentication Techniques: A Comprehensive Survey Multimedia Systems 24 2018 211 240 https://doi.org/10.1007/s00530-017-0538-9
- Simonyan , K. , and Zisserman , A. 2014
- Dong , J. , Wang , W. , and Tan , T. 2013
- Silva , E. , Carvalho , T. , Ferreira , A. , and Rocha , A. Going Deeper into Copy-Move Forgery Detection: 27 Exploring Image Telltales Via Multi-Scale Analysis and Voting Processes J. Vis. Commun. Image Represent. 29 2015 16 32
- Ortega , J. , Kose , N. , Cañas , P. , Chao , M.A. , et al. 2020 DMD: A Large-Scale Multi-Modal Driver Monitoring Dataset for Attention and Alertness Analysis Proceedings of the European Conference on Computer Vision (ECCV) Workshops
- Lopes A.T. , de Aguiar E. , De Souza A.F. Oliveira-Santos T. Facial Expression Recognition with Convolutional Neural Networks: Coping with Few Data and the Training Sample Order Pattern Recognit. 61 610 628 2017 10.1016/j.patcog.2016.07.026
- Xing Y. , Lv C. , Wang H. , Cao D. , Velenis E. and Wang F. Driver Activity Recognition for Intelligent Vehicles: A Deep Learning Approach IEEE Transactions on Vehicular Technology 68 6 5379 5390 2019 10.1109/TVT.2019.2908425
- Bergasa , L.M. , Nuevo , J. , Sotelo , M.A. , Barea , R. et al. Real-Time System for Monitoring Driver Vigilance IEEE Trans. Intell. Transport. Syst 7 2006 63 77