This content is not included in
your SAE MOBILUS subscription, or you are not logged in.
Rain-Adaptive Intensity-Driven Object Detection for Autonomous Vehicles
Technical Paper
2020-01-0091
ISSN: 0148-7191, e-ISSN: 2688-3627
This content contains downloadable datasets
Annotation ability available
Sector:
Language:
English
Abstract
Deep learning based approaches for object detection are heavily dependent on the nature of data used for training, especially for vehicles driving in cluttered urban environments. Consequently, the performance of Convolutional Neural Network (CNN) architectures designed and trained using data captured under clear weather and favorable conditions, could degrade rather significantly when tested under cloudy and rainy conditions. This naturally becomes a major safety issue for emerging autonomous vehicle platforms relying on CNN based object detection methods. Furthermore, despite a noticeable progress in the development of advanced visual deraining algorithms, they still have inherent limitations for improving the performance of state-of-the-art object detection. In this paper, we address this problem area by make the following contributions. We systematically study and quantify the influence of a wide range of rain intensities on the performance of popular deep learning based object detection that is trained with clear visual data. We show that even low rain intensities could significantly degrade the performance of object detection trained using clear visuals. Subsequently, we propose a Rain-Adaptive Intensity-Driven (RAID) deep learning framework for object detection under a variety of rain intensities. Controlled experiments based on rain simulations, which are seamlessly integrated with real visual data captured by moving vehicles in truly cluttered urban environments, show the superiority of the proposed RAID framework as compared with state-of-the-art deraining methods in conjunction with popular deep learning based object detection.
Recommended Content
Topic
Citation
Hnewa, M. and Radha, H., "Rain-Adaptive Intensity-Driven Object Detection for Autonomous Vehicles," SAE Technical Paper 2020-01-0091, 2020, https://doi.org/10.4271/2020-01-0091.Data Sets - Support Documents
Title | Description | Download |
---|---|---|
Unnamed Dataset 1 |
Also In
References
- Chen , C. , Seff , A. , Kornhauser , A. , and Xiao , J. DeepDriving: Learning Affordance for Direct Perception in Autonomous Driving IEEE ICCV 2722 2730 2015
- Wu , B. , Iandola , F. , Jin , P.H. , and Keutzer , K. SqueezeDet: Unified, Small, Low Power Fully Convolutional Neural Networks for Real-Time Object Detection for Autonomous Driving 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) 2017 446 454
- Teichmann , M. , Weber , M. , Zöllner , M. , Cipolla , R. , and Urtasun , R. MultiNet: Real-Time Joint Semantic Reasoning for Autonomous Driving 2018 IEEE Intelligent Vehicles Symposium (IV) 2018 1013 1020
- Girshick , R. , Donahue , J. , Darrell , T. , and Malik , J. Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation IEEE CVPR 580 587 2014
- Girshick , R. Fast R-CNN CVPR 1440 1448 2015
- Redmon , J. , Divvala , S. , Girshick , R. , and Farhadi , A. You Only Look Once: Unified, Real-Time Object Detection CVPR 779 788 2016
- Cai , Z. , Fan , Q. , Feris , R.S. , and Vasconcelos , N. A Unified Multi-Scale Deep Convolutional Neural Network for Fast Object Detection ECCV 2016 354 370 2016
- Ren , S. , He , K. , Girshick , R. , and Sun , J. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks IEEE Transactions on Pattern Analysis and Machine Intelligence 39 6 1137 1149 Jun. 2017
- Garg , K. and Nayar , S.K. Detection and Removal of Rain from Videos IEEE CVPR 2004 1 I-I 2004
- Zhang , X. , Li , H. , Qi , Y. , Leow , W.K. , and Ng , T.K. Rain Removal in Video by Combining Temporal and Chromatic Properties 2006 IEEE International Conference on Multimedia and Expo 2006 461 464
- Kang , L. , Lin , C. , and Fu , Y. Automatic Single-Image-Based Rain Streaks Removal Via Image Decomposition IEEE Transactions on Image Processing 21 4 1742 1755 Apr. 2012
- Kim , J. , Sim , J. , and Kim , C. Video Deraining and Desnowing Using Temporal Correlation and Low-Rank Matrix Completion IEEE Transactions on Image Processing 24 9 2658 2670 Sep. 2015
- Fu , X. , Huang , J. , Ding , X. , Liao , Y. , and Paisley , J. Clearing the Skies: A Deep Network Architecture for Single-Image Rain Removal IEEE Transactions on Image Processing 26 6 2944 2956 Jun. 2017
- Jiang , T. , Huang , T. , Zhao , X. , Deng , L. , and Wang , Y. A Novel Tensor-Based Video Rain Streaks Removal Approach Via Utilizing Discriminatively Intrinsic Priors CVPR 2818 2827 2017
- Chen , J. , Tan , C.-H. , Hou , J. , Chau , L.-P. , and Li , H. Robust Video Content Alignment and Compensation for Rain Removal in a CNN Framework CVPR 6286 6295 2018
- Fu , X. , Huang , J. , Zeng , D. , Huang , Y. et al. Removing Rain from Single Images Via a Deep Detail Network CVPR 1715 1723 2017
- Liu , J. , Yang , W. , Yang , S. , and Guo , Z. Erase or Fill? Deep Joint Recurrent Rain Removal and Reconstruction in Videos CVPR 3233 3242 2018
- Wang , Z. , Bovik , A.C. , Sheikh , H.R. , and Simoncelli , E.P. Image Quality Assessment: From Error Visibility to Structural Similarity IEEE Transactions on Image Processing 13 4 600 612 Apr. 2004
- Brazil , G. , Yin , X. , and Liu , X. Illuminating Pedestrians Via Simultaneous Detection and Segmentation ICCV 4960 4969 2017
- Xu , D. , Ouyang , W. , Ricci , E. , Wang , X. , and Sebe , N. Learning Cross-Modal Deep Representations for Robust Pedestrian Detection CVPR 4236 4244 2017
- Li , J. , Liang , X. , Shen , S. , Xu , T. et al. Scale-Aware Fast R-CNN for Pedestrian Detection IEEE Transactions on Multimedia 20 4 985 996 Apr. 2018
- Ouyang , W. , Zhou , H. , Li , H. , Li , Q. et al. Jointly Learning Deep Features, Deformable Parts, Occlusion and Classification for Pedestrian Detection IEEE Transactions on Pattern Analysis and Machine Intelligence 40 8 1874 1887 Aug. 2018
- Redmon , J. and Farhadi , A. 2017
- Redmon , J. and Farhadi , A. 2018
- https://github.com/udacity/self-driving-car 2018
- Adobe After Effects CC Sab Jose, CA Adobe Inc. 2018
- Everingham , M. and Winn , J. 2011
- Cartucho https://github.com/Cartucho/mAP 2018