This content is not included in
your SAE MOBILUS subscription, or you are not logged in.
Application of Deep Learning Methods for Pedestrian Collision Detection Using Dashcam Videos
Technical Paper
2020-22-0008
This content contains downloadable datasets
Annotation ability available
Sector:
Language:
English
Abstract
The goal of this study is to clarify the usefulness of deep learning methods for pedestrian collision detection using dashcam videos for advanced automatic collision notification, focusing on pedestrians, as they make up the highest number of traffic fatalities in Japan. First, we created a dataset for deep learning from dashcam videos. A total of 78 dashcam videos of pedestrian-to-automobile accidents were collected from a video hosting website and from the Japan Automobile Research Institute (JARI). Individual frames were selected from the video data amounting to a total of 1,212 still images, which were added to our dataset with class and location information. This dataset was then divided to create training, validation, and test datasets. Next, deep learning was performed based on the training dataset to learn the features of pedestrian collision images, which are images that capture pedestrian behavior at the time of the collision. Pedestrian collision detection performance of the trained model was evaluated as the percentage of correct predictions of pedestrian collisions in image data according to varied test sets with different combinations of characteristics. Our results for the proposed method show high-precision collision detection for daytime, clear pedestrian wrap trajectory accident data, including accurate detection of pedestrian collision location information. However, nighttime, unclear accident data resulted in false detection or no detection. Reduction of exposure value and resolution was confirmed to reduce detection rate. The results of the present study suggest the possibility of pedestrian collision detection by deep learning using dashcam videos.
Authors
Citation
Kunitomi, S., Takayama, S., and Shirakawa, M., "Application of Deep Learning Methods for Pedestrian Collision Detection Using Dashcam Videos," SAE Technical Paper 2020-22-0008, 2021, https://doi.org/10.4271/2020-22-0008.Data Sets - Support Documents
| Title | Description | Download |
|---|---|---|
| Unnamed Dataset 1 | ||
| Unnamed Dataset 2 | ||
| Unnamed Dataset 3 | ||
| Unnamed Dataset 4 | ||
| Unnamed Dataset 5 |
Also In
References
- Adebayo , J. , Gilmer , J. , Muelly , M , Goodfellow , I. , Hardt , M , Kim , B. 2018 Sanity checks for saliency maps Advances in Neural Information Processing Systems 31 9505 9515
- Adobe 2018 Photoshop Elements 2019 https://helpx.adobe.com/photoshop-elements/user-guide.html
- Augenstein , J. , Digges , K. , Perdeck , E. , Statton , J. , Bahouth , G. , Baur , P. , & Messner , G. 2007 Application of ACN data to improve vehicle safety and occupant care Proceedings of Enhanced Safety of Vehicles Conference Lyon, France
- Chan , F. H., Chen , Y. T., Xiang , Y. , Sun , M. 2016 Anticipating accidents in dashcam videos Asian Conference on Computer Vision 136 153 Springer, Cham
- Deng , J. , Berg , A. , Satheesh , S. , Su , H. , Khosla , A. , Fei-Fei , L. 2012 Imagenet large scale visual recognition competition 2012 (ILSVRC2012)
- Evening , M. 2013 Adobe Photoshop CS5 for Photographers: a professional image editor's guide to the creative use of Photoshop for the Macintosh and PC Taylor & Francis 7
- Goodfellow , I. , Bengio , Y , Courville , A. , Bengio , Y. 2016 Deep learning 1 120 121 MIT press Cambridge
- Grm , K. , Š truc , V. , Artiges , A. , Caron , M. , Ekenel , H. K. 2017 Strengths and weaknesses of deep learning models for face recognition against image degradations Iet Biometrics 7 1 81 89
- Han , Y. , Li , Q. , He , W. , Wan , F. , Wang , B. , Mizuno , K. 2017 Analysis of vulnerable road user kinematics before/during/after vehicle collisions based on video records Proceedings of IRCOBI Conference Antwerp, Belgium 13 15
- He , K. , Zhang , X. , Ren , S. , Sun , J. 2015 Delving deep into rectifiers: Surpassing human-level performance on imagenet classification Proceedings of the IEEE international conference on computer vision 1026 1034
- Hossain , M. S. , Muhammad , G. 2019 Emotion recognition using deep learning approach from audio-visual emotional big data Information Fusion 49 69 78
- Hu , J. , Shen , L. , Sun , G. 2018 Squeeze-and-excitation networks Proceedings of the IEEE conference on computer vision and pattern recognition 7132 7141
- Kahou , S. E. , Bouthillier , X. , Lamblin , P. , Gulcehre , C. , Michalski , V. , Konda , K. , Ferrari , R. C. 2016 Emonets: Multimodal deep learning approaches for emotion recognition in video Journal on Multimodal User Interfaces 10 2 99 111
- Kannojia , S.P. , Jaiswal , G. 2018 Effects of Varying Resolution on Performance of CNN based Image Classification: An Experimental Study International Journal of Computer Sciences and Engineering 6 9 451 456
- Kingma , D. P., Ba , J. 2014 Adam: A method for stochastic optimization arXiv preprint arXiv:1412.6980
- Kodera , T. , Mase , Y. , Kato , M. , Takenaka , K. 2018 Enhancement of Pop up Hood Operating System by Cooperation between Active Sensor and Passive Sensor Proceedings of Journal of Society of Automotive Engineers of Japan 21 18 1 4
- Krizhevsky , A. , Sutskever , I. , Hinton , G. E. 2012 Imagenet classification with deep convolutional neural networks Advances in neural information processing systems 1097 1105
- Kubo , N. , Mori , M. 2011 An Effective Automatic Classification Method of Drive Recorder Data The Japan Society of Mechanical Engineers 77 778
- Lee , E. , Wu , J. , Enriquez , J. , Martin , J. , & Craig , M. 2019 Advanced Automatic Collision Notification Research Report (No.DOT HS 812 729) United States Department of Transportation National Highway Traffic Safety Administration
- Lu , Y. , Yi , S. , Zeng , N. , Liu , Y. , Zhang , Y. 2017 Identification of rice diseases using deep convolutional neural networks Neurocomputing 267 378 384
- Lundberg , S. M., Lee , S. I. 2017 A unified approach to interpreting model predictions Advances in neural information processing systems 4765 4774
- Microsoft 2019 Visual Object Tagging Tool: VoTT https://github.com/microsoft/VoTT
- Ministry of Land Infrastructure Transport and Tourism of Japan (MLIT 2016 Tenth Fundamental Traffic Safety Program (in Japanese) https://www8.cao.go.jp/koutu/kihon/keikaku10/pdf/kihon_keikaku.pdf
- Ministry of Land Infrastructure Transport and Tourism of Japan (MLIT 2019 Japanese New Car Assessment Program https://www.mlit.go.jp/jidosha/anzen/02assessment/documents.html
- National Police Agency of Japan (NPA 2019 Statistics about Road Traffic / Annual report https://www.e-stat.go.jp/en/stat-search/files?page=1&query=accident%20fatal&sor t=tstat_name%20asc&layout=dataset&stat_infid=0 00031911561&metadata=1&data=1
- Putra , M. H. , Yussof , Z. M. , Salim , S. I. , Lim , K. C. 2017 Convolutional Neural Network for Person Detection using YOLO Framework Journal of Telecommunication, Electronic and Computer Engineering (JTEC 9 2-13 1 5
- Ravani , B. , Brougham , D. , Mason , R. T. 1981 Pedestrian post-impact kinematics and injury patterns SAE Transactions 3279 3292
- Redmon , J. , Divvala , S. , Girshick , R. , Farhadi , A. 2016 You only look once: Unified, real-time object detection Proceedings of the IEEE conference on computer vision and pattern recognition 779 788
- Redmon , J. , Farhadi , A. 2018 Yolov3: An incremental improvement arXiv preprint arXiv:1804.02767
- Ribeiro , M. T. , Singh , S. , Guestrin , C. 2016 August Why should I trust you?" Explaining the predictions of any classifier Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining 1135 1144
- Russakovsky , O. , Deng , J. , Su , H. , Krause , J. , Satheesh , S. , Ma , S. , Berg , A. C. 2015 Imagenet large scale visual recognition challenge International Journal of Computer Vision 115 3 211 252
- Sabottke , C. F. , Spieler , B. M. 2020 The effect of image resolution on deep learning in radiography Radiology: Artificial Intelligence 2 1 e190015
- Shah , A. P. , Lamare , J. B. , Nguyen-Anh , T. , Hauptmann , A. 2018 CADP: A novel dataset for CCTV traffic camera based accident analysis 2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS 1 9 IEEE
- Sultani , W. , Chen , C. , Shah , M. 2018 Real-world anomaly detection in surveillance videos Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 6479 6488
- Volk , G. , Müller , S. , von Bernuth , A. , Hospach , D. , Bringmann , O. 2019 Towards Robust CNN-based Object Detection through Augmentation with Synthetic Rain Variations 2019 IEEE Intelligent Transportation Systems Conference (ITSC 285 292
- Wang , H. , Du , M. , Yang , F. , Zhang , Z. 2019 Score-CAM: Improved Visual Explanations Via Score-Weighted Class Activation Mapping arXiv preprint arXiv:1910.01279
- World Health Organization (WHO 1981 Planning and organization of emergency medical services EURO Reports and Studies 35 21 28
- Wu , Z. , Yao , T. , Fu , Y. , Jiang , Y. G. 2017 Deep learning for video classification and captioning Frontiers of Multimedia Research 3 29
- Xu , T. , Zhang , H. , Huang , X. , Zhang , S. , Metaxas , D. N. 2016 Multimodal deep learning for cervical dysplasia diagnosis International Conference on Medical Image Computing and Computer-Assisted Intervention 115 123 Springer, Cham
- Yoshida , S. , Hasegawa , T. , Tominaga , S. , Nishimoto , T. 2012 Injury Prediction Model for Automatic Collision Notification Based on Japanese Accident Data Proceedings of Journal of Society of Automotive Engineers of Japan 43 2 275 280