This content is not included in your SAE MOBILUS subscription, or you are not logged in.
Vehicular Visual Sensor Blinding Detection by Integrating Variational Autoencoders with SVM
ISSN: 0148-7191, e-ISSN: 2688-3627
Published April 06, 2021 by SAE International in United States
This content contains downloadable datasetsAnnotation ability available
Event: SAE WCX Digital Summit
The advancements of autonomous vehicles or advanced driver assistance systems in terms of safety, driving experience, and comfort against manual driving results in extensive adoption of them across the modern automotive sector. The autonomous vehicles are equipped with numerous sensing and actuating components both inside as well as outside the vehicles to perceive the environment, perform path planning, and intelligently control the autonomous vehicles. The perception mechanism includes fused information of multiple sensors such as camera, RADAR, and LiDAR to effectively understand all the dynamic driving environments. Some of the intentional and unintentional mechanisms such as cyber-attacks and natural variations of the environment, etc., across the sensor's external interface with the environment cause the degradation of the perception mechanism. One of these major mechanisms on the visual camera sensors includes blinding of the camera, which is done either deliberately by cyber-attackers by projecting the light into the camera or naturally by sunlight/vehicle illuminations. Due to the visual sensors blinding mechanisms either fully or partially fails object detection by the vehicular perception system. Hence, here a novel visual sensor blinding detection system is proposed by modeling the visual sensor blinding as an anomaly detection problem. The video image frames coming from the camera form the normal behavior and the blinded frames form the anomaly behavior. The proposed system uses the unsupervised variational autoencoder deep neural networks, where its encoder outputs the probability distribution of the data in the latent space. The variational autoencoders output the probability distributions of the large normal behavioral camera video data and the small blinded anomaly video data into a latent space, where the separated two probability distributions are classified using a powerful support vector machine (SVM) classifiers. The powerful support vector machine classifiers classify the normal non-blinded camera data from the blinded data from the latent space. The proposed system classifies the incoming visual sensor data from the camera into normal and anomaly classes by combining the variational autoencoders with the support vector machines for the successful detection of the visual sensors blinding on the autonomous vehicles.
CitationS M, S. and Karki, M., "Vehicular Visual Sensor Blinding Detection by Integrating Variational Autoencoders with SVM," SAE Technical Paper 2021-01-0144, 2021, https://doi.org/10.4271/2021-01-0144.
Data Sets - Support Documents
|Unnamed Dataset 1|
|Unnamed Dataset 2|
|Unnamed Dataset 3|
|Unnamed Dataset 4|
|Unnamed Dataset 5|
- Akdemir , K.D. , Karakoyunlu , D. , Padir , T. , and Sunar , B. An Emerging Threat: Eve Meets a Robot International Conference on Trusted Systems Springer 2010 271 289
- Wyglinski , A.M. , Huang , X. , Padir , T. , Lai , L. et al. Security of Autonomous Systems Employing Embedded Computing and Sensors IEEE Micro 33 1 80 86 2013
- Miller , C. and Valasek , C. A Survey of Remote Automotive Attack Surfaces Black Hat USA 2014
- Checkoway , S. , McCoy , D. , Kantor , B. , Anderson , D. et al. Comprehensive Experimental Analyses of Automotive Attack Surfaces USENIX Security Symposium 2011
- Larson , U.E. , Nilsson , D.K. , and Jonsson , E. An Approach to Specification-Based Attack Detection for In-Vehicle Networks Intelligent Vehicles Symposium 2008 220 225
- Vallance , C. July 2015
- CERT-UK 2015
- Sichitiu , M.L. , and Kihl , M. Inter-Vehicle Communication Systems: A Survey IEEE Communications Surveys & Tutorials 10 2 88 105 2008
- Miller , C. and Valasek , C. Remote Exploitation of an Unaltered Passenger Vehicle Black Hat USA 2015
- Petit , J. , Stottelaar , B. , and Feiri , M. 2015
- Shin , H. , Kim , D. , Kwon , Y. , and Kim , Y. Illusion and Dazzle: Adversarial Optical Channel Exploits against Lidars for Automotive Applications Cryptographic Hardware and Embedded Systems - CHES 2017 2017 445 467
- Yahiaoui , L. , Uřičář , M. , Das , A. , and Yogamani , S. Let the Sunshine Sun Glare Detection on Automotive Surround-View Cameras 2020
- Zhang , F. , Lu , J. , Hu , X. , and Hao , X. Investigating Safety Impact of Sun Glare in Urban Tunnels Based on Cellular Automata Approach Accident Analysis & Prevention 148 105821 2020
- Madan , N. and Geetha , K.S. Development of Glare Recognition for Advanced Driver Assistance System Lecture Notes in Computational Vision and Biomechanics 2018
- Yu , F. , Chen , H. , Wang , X. , Xian , W. et al.