This content is not included in
your SAE MOBILUS subscription, or you are not logged in.
Decade of Vision-Based Pedestrian Detection for Self-Driving: An Experimental Survey and Evaluation
Technical Paper
2018-01-1603
ISSN: 0148-7191, e-ISSN: 2688-3627
Annotation ability available
Sector:
Language:
English
Abstract
With the steady progress in autonomous driving technology and the tremendous potential prospects for development, the topics about self-driving car have begun to return to the center stage of AI applications. Hence, lots of efforts are made on algorithms relevant to self-driving car itself. However, few shed the light on the problem of how to testify them thoroughly, therefore unified standards for autonomous driving and testing are urgently needed. To study this problem, we begin by pedestrian detection, for that the ability of locating humans is one of the most critical problems that should be concerned about for self-driving cars. In this paper, we investigate to perform a standard evaluation to qualify different methods and detectors under a more practical manner. Specifically, we investigate several commonly used evaluation methodologies for pedestrian detection, and find out that the Caltech pedestrian detection benchmark is the most popular. However, it’s still not suitable enough for the pedestrian detection problem in autonomous driving for not taking any emergency in practice into account. Besides, other benchmarks such as KITTI which evaluates the PASCAL-style mean Average Precision are also very inspirational. Our contributions are four-folds in this paper: (i) Summarizing existing pedestrian arts, figure out the most convincing ones in the literature. (ii) Based on these most popular methods, we aim to propose a rational and unitary novel performance metrics tailor-made for evaluating the capacity of pedestrian detection for self-driving cars. (iii) Our testing standards take into account not only the general orientation of pedestrian detectors but also various practical application scenes. (iv) We also report the evaluation results of some promising pedestrian algorithms, to show the superiority of our testing standards.
Authors
Topic
Citation
Zhang, Y., Qi, Y., Liu, J., and Wang, Y., "Decade of Vision-Based Pedestrian Detection for Self-Driving: An Experimental Survey and Evaluation," SAE Technical Paper 2018-01-1603, 2018, https://doi.org/10.4271/2018-01-1603.Also In
References
- Autonomous Vehicles Readliness Index https://assets.kpmg.com/content/dam/kpmg/nz/pdf/February/Autonomous_Vehicles_Report_2018.pdf
- Automated Driving Systems: A Vision for Safety https://www.nhtsa.gov/sites/nhtsa.dot.gov/files/documents/13069a-ads2.0_090617_v9a_tag.pdf
- Blanco , M. , Atwood , J. , Russell , S. , Trimble , T.E. et al. 2016
- Dollár , P. , Wojek , C. , Schiele , B. , and Perona , P. Pedestrian Detection: An Evaluation of the State of the Art PAMI 2012 10.1109/TPAMI.2011.155
- Geiger , A. , Lenz , P. , and Urtasun , R. Are We Ready for Autonomous Driving? The Kitti Vision Benchmark Suite CVPR 2012 10.1109/CVPR.2012.6248074
- Dalal , N. and Triggs , B. Histograms of Oriented Gradients for Human Detection CVPR 2005 10.1109/CVPR.2005.177
- Ess , A. , Leibe , B. , Schindler , K. , and Van Gool , L. A Mobile Vision System for Robust: Multi-Person Tracking CVPR 2008 10.1109/CVPR.2008.4587581
- Wojek , C. , Walk , S. , and Schiele , B. Multi-cue Onboard Pedestrian Detection CVPR 2009 10.1109/CVPR.2009.5206638
- Hwang , S. , Park , J. , Kim , N. , Choi , Y. et al. Multispectral Pedestrian Detection: Benchmark Dataset and Baseline Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR) 2015 1037 1045 10.1109/CVPR.2015.7298706
- Davis , J. and Keck , M. A Two-Stage Approach to Person Detection in Thermal Imagery Proceedings of the Workshop on Applications of Computer Vision 2005 10.1109/ACVMOT.2005.14
- Kwak , J.-Y. , Ko , B.C. , and Nam , J.-Y. Pedestrian Tracking Using Online Boosted Random Ferns Learning in Far Infrared Imagery for Safe Driving at Night IEEE Transactions on Intelligent Transportation System 18 1 69 81 Jan. 2017 10.1109/TITS.2016.2569159
- Ko , B.C. , Jeong , M. , and Nam , J.-Y. IEEE Trans. ITS 2014
- Zhang , S. , Benenson , R. , Omran , M. , Hosang , J. et al. How Far Are We from Solving Pedestrian Detection? CVPR 2016 10.1109/CVPR.2016.141
- Enzweiler , M. and Gavrila , D.M. Monocular Pedestrian Detection: Survey and Experiments IEEE Transactions on Pattern Analysis and Machine Intelligence 31 12 2179 2195 Dec. 2009 10.1109/TPAMI.2008.260
- Papageorgiou , C. and Poggio , T. A Trainable System for Object Detection International Journal of Computer Vision 38 1 15 33 2000
- Viola , P. , Jones , M. , and Snow , D. Detecting Pedestrians Using Patterns of Motion and Appearance Proceedings Ninth IEEE International Conference on Computer Vision 2003 10.1109/ICCV.2003.1238422
- Lowe , D.G. Distinctive Image Features from Scale-Invariant Keypoints International Journal of Computer Vision 60 2 91 110 2004 10.1023/B:VISI.0000029664.99615.94
- Dalal , N. and Triggs , B. Histograms of Oriented Gradients for Human Detection CVPR 2005 10.1109/CVPR.2005.177
- Felzenszwalb , P. , McAllester , D. , and Ramanan , D. A Discriminatively Trained, Multiscale, Deformable Part Model CVPR 2008 10.1109/CVPR.2008.4587597
- Benenson , R. , Omran , M. , Hosang , J. , and Schiele , B. Ten Years of Pedestrian Detection, What Have We Learned? ECCV, CVRSUAD Workshop 2014 10.1007/978-3-319-16181-5_47
- Geronimo , D. , Lopez , A.M. , Sappa , A.D. , and Graf , T. Survey on Pedestrian Detection for Advanced Driver Assistance Systems IEEE Trans. Pattern Analysis and Machine Intelligence 32 7 1239 1258 2010 10.1109/TPAMI.2009.122
- Girshick , R. , Donahue , J. , Darrell , T. , and Malik , J. Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation CVPR 2014 10.1109/CVPR.2014.81
- Krizhevsky , A. , Sutskever , I. , and Hinton , G.E. Imagenet Classification with Deep Convolutional Neural Networks NIPS 2012 10.1145/3065386
- Girshick , R. Fast R-CNN ICCV 2015 10.1109/ICCV.2015.169
- Ren , S. , He , K. , Girshick , R. , and Sun , J. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks IEEE Transactions on Pattern Analysis & Machine Intelligence 39 6 1137 1149 2017 10.1109/TPAMI.2016.2577031
- Angelova , A. , Krizhevsky , A. , Vanhoucke , V. , Ogale , A. et al. Real-Time Pedestrian Detection with Deep Network Cascades BMVC 2015 10.5244/C.29.32
- Dollár , P. , Appel , R. , Belongie , S. , and Perona , P. Fast Feature Pyramids for Object Detection PAMI 2014 10.1109/TPAMI.2014.2300479
- Tian , Y. , Luo , P. , Wang , X. , and Tang , X. Deep Learning Strong Parts for Pedestrian Detection ICCV 2015 10.1109/ICCV.2015.221
- Zhang , L. , Lin , L. , Liang , X. , and He , K. Is Faster RCNN Doing Well for Pedestrian Detection? ECCV 2016
- Li , J. , Liang , X. , Shen , S. , Xu , T. et al. Fast R-CNN for Pedestrian Detection CoRR 2015 1510.08160
- Dai , J. , Li , Y. , He , K. , and Sun , J. Computer Vision and Pattern Recognition 2016
- Xu , Y. , Xu , D. , Lin , S. , Han , T.X. et al. Detection of Sudden Pedestrian Crossings for Driving Assistance Systems IEEE Trans. Syst., Man, Cybern. B, Cybern. 42 3 729 739 June 2012
- Dollár , P. , Wojek , C. , Schiele , B. , and Perona , P. Pedestrian Detection: A Benchmark CVPR 2009 10.1109/CVPR.2009.5206631
- Nam , W. , Dollár , P. , and Han , J.H. Local Decorrelation for Improved Pedestrian Detection NIPS 2014 Montreal, Quebec 2014
- Zhang , S. , Benenson , R. , and Schiele , B. Filtered Channel Features for Pedestrian Detection CVPR 2015 Boston, MA 2015 10.1109/CVPR.2015.7298784
- Zhang , S. , Benenson , R. , and Schiele , B. Computer Vision and Pattern Recognition 2017 10.1109/CVPR.2017.474
- Cordts , M. , Omran , M. , Ramos , S. , Rehfeld , T. et al. The Cityscapes Dataset for Semantic Urban Scene Understanding Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2016 10.1109/CVPR.2016.350