This content is not included in
your SAE MOBILUS subscription, or you are not logged in.
MTCNN-KCF-deepSORT:Driver Face Detection and Tracking Algorithm Based on Cascaded Kernel Correlation Filtering and Deep SORT
Technical Paper
2020-01-1038
ISSN: 0148-7191, e-ISSN: 2688-3627
This content contains downloadable datasets
Annotation ability available
Sector:
Language:
English
Abstract
The driver's face detection and tracking method important for Advanced Driver Assistance Systems (ADAS) and autonomous driving in various situations. The deep SORT algorithm has integrated appearance information, the motion model and the intersection-over-union (IOU) distance methods, and has been applied to face tracking, but it depends on detection information in every frame. Once the detection information lacks, the deep SORT algorithm will wait until the target detects bounding boxes appear again, even if the target didn’t disappear or shield. Hence, we propose to use a new tracker that not completely depend on the detection algorithm to cascade with the deep SORT algorithm to realize stable driver's face tracking. At first, the driver's face detection and tracking will be accomplished by the MTCNN-deep-SORT algorithm. Multi-task convolutional neural network (MTCNN) will complete the driver's face detection, and detected face bounding boxes will be transferred into deep SORT tracking algorithm, at this step, we will get the driver's face detection and tracking bounding boxes. Subsequently, the detection of bounding boxes is transferred to the kernel correlation filtering (KCF) tracking algorithm. When the driver's face is not detected, the KCF tracker will use the last frame detection information to track the driver's face at the current frame, transfer the tracking information into the deep SORT algorithm and reidentify the driver's face in the current frame. In case that the detection is not lost, we only record detection information in the KCF tracker and do not start the tracker. So, we have successfully cascaded the deep learning tracking method and the traditional feature tracking method. Volunteer experiments on 20 drivers show that our cascaded tracking algorithm method achieves more stable driver's face detection and tracking when the driver's head posture changes greatly.
Recommended Content
Authors
Topic
Citation
liao, J., Wang, Q., Cao, L., Xia, J. et al., "MTCNN-KCF-deepSORT:Driver Face Detection and Tracking Algorithm Based on Cascaded Kernel Correlation Filtering and Deep SORT," SAE Technical Paper 2020-01-1038, 2020, https://doi.org/10.4271/2020-01-1038.Data Sets - Support Documents
Title | Description | Download |
---|---|---|
Unnamed Dataset 1 | ||
Unnamed Dataset 2 | ||
Unnamed Dataset 3 |
Also In
References
- Girshick , R. , Donahue , J. , Darrell , T. , Malik , J. , and Berkeley , U.C. Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation 2014 IEEE Conference on Computer Vision and Pattern Recognition IEEE 2014 580 587 10.1109/CVPR.2014.81
- Krizhevsky , A. , Sutskever , I. , and Hintom , G.E. ImageNet Classification with Deep Convolutional NeuralNetworks International Conference on Neural Information Processing Systems 2012 10.1145/3065386
- Girshick , R. Fast R-CNN Proceedings of the IEEE International Conference on Computer Vision 2015 1440 1448 9781467383912 10.1109/ICCV.2015.169
- Ren , S. , He , K. , Girshick , R. , and Sun , J. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks IEEE Trans. Pattern Anal. Mach. Intell. 39 6 1137 1149 2017 10.1109/TPAMI.2016.2577031
- Wang , H. , Li , Z. , Ji , X. , and Wang , Y. 2017
- Computer Vision -- ECCV 2016 Wen , Y. , Zhang , K. , Li , Z. , and Qiao , Y. A Discriminative Feature Learning Approach for Deep Face Recognition Leibe , B. , Matas , J. , Sebe , N. , and Welling , M. Cham Springer International Publishing 2016 499 515 978-3-319-46478-7
- Yang , S. , Luo , P. , Loy , C.C. , and Tang , X. Faceness-Net: Face Detection through Deep Facial Part Responses IEEE Trans. Pattern Anal. Mach. Intell. 40 8 1845 1859 2018 10.1109/TPAMI.2017.2738644
- Yang , S. , Luo , P. , Loy , C.C. , and Tang , X. From Facial Parts Responses to Face Detection: A Deep Learning Approach Proceedings of the IEEE International Conference on Computer Vision 2015 3676 3684 9781467383912 10.1109/ICCV.2015.419
- Loy , C. , Luo , P. , Chen , Q. , and Huang , C. 2017 978-3-319-50075-1 10.1007/978-3-319-50077-5
- Najibi , M. , Samangouei , P. , Chellappa , R. , and Davis , L.S. SSH: Single Stage Headless Face Detector Proceedings of the IEEE International Conference on Computer Vision 2017 4885 4894 9781538610329 10.1109/ICCV.2017.522
- Zhang , S. , Zhu , X. , Lei , Z. , Shi , H. , Wang , X. , and Li , S.Z. S3FD: Single Shot Scale-Invariant Face Detector Proceedings of the IEEE International Conference on Computer Vision 2017 192 201 9781538610329 10.1109/ICCV.2017.30
- Bai , Y. and Ghanem , B. 2017
- Yang , S. , Xiong , Y. , Loy , C.C. , and Tang , X. 2017
- Ranjan , R. , Patel , V.M. , and Member , S. HyperFace: A Deep Multi-Task Learning Framework for Face Detection, Landmark Localization, Pose Estimation, and Gender Recognition IEEE Trans. Pattern Anal. Mach. Intell. 41 1 121 135 2019 10.1109/TPAMI.2017.2781233
- Li , H. , Lin , Z. , Shen , X. , and Hua , G. A Convolutional Neural Network Cascade for Face Detection CEUR Workshop Proceedings 2016 375 387 9781467369640 10.1109/CVPR.2015.7299170
- Zhang , K. , Zhang , Z. , Li , Z. , and Qiao , Y. Joint Face Detection and Alignment Using Multitask Cascaded Convolutional Networks IEEE Signal Process. Lett. 23 10 1499 1503 2016 10.1109/LSP.2016.2603342
- Bolme , D.S. , Draper , B.A. , and Beveridge , J.R. Average of Synthetic Exact Filters 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2009 2009 2105 2112 9781424439935 10.1109/CVPRW.2009.5206701
- Mueller , M. , Smith , N. , and Ghanem , B. 2018 10.1117/12.2514676
- Bolme , D.S. , Beveridge , J.R. , Draper , B.A. , and Lui , Y.M. Visual Object Tracking using Adaptive Correlation Filters Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition 2010 2544 2550 9781424469840 10.1109/CVPR.2010.5539960
- Henriques , J.F. , Caseiro , R. , Martins , P. , and Batista , J. High-Speed Tracking with Kernelized Correlation Filters IEEE Trans. Pattern Anal. Mach. Intell. 37 3 583 596 2015 10.1109/TPAMI.2014.2345390
- Feichtenhofer , C. , Pinz , A. , and Zisserman , A.
- Bewley , A. , Ge , Z. , Ott , L. , Ramos , F. , and Upcroft , B. Simple Online and Realtime Tracking Proceedings - International Conference on Image Processing, ICIP 2016 3464 3468 9781467399616 10.1109/ICIP.2016.7533003
- Wojke , N. , Bewley , A. , and Paulus , D. Simple online and Realtime Tracking with a Deep Association Metric Proceedings - International Conference on Image Processing, ICIP 2018 3645 3649 9781509021758 10.1109/ICIP.2017.8296962
- Benavente , R. 2014
- Yi , D. , Lei , Z. , Liao , S. , and Li , S.Z. 2014
- Hong-Wei , N. , and Stefan , W. A Data-Driven Approach To Cleaning Large Face Datasets Advanced Digital Sciences Center (ADSC) International Conference on Image Processing(ICIP) University of Illinois at Urbana-Champaign, Singapore 2014 343 347 9781479957514
- Wong , Y. , Chen , S. , Mau , S. , Sanderson , C. , and Lovell , B.C. Patch-Based Probabilistic Image Quality Assessment for Face Selection and Improved Video-Based Face Recognition IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops 2011 74 81 9781457705298 10.1109/CVPRW.2011.5981881
- Lin , T.Y. , Goyal , P. , Girshick , R. , He , K. , and Dollar , P. Focal Loss for Dense Object Detection Proceedings of the IEEE International Conference on Computer Vision 2017 2999 3007 9781538610329 10.1109/ICCV.2017.324
- Jain , V. and Learned-Miller , E. Fddb: A Benchmark for Face Detection in Unconstrained Settings UMass Amherst Technical Report 2010
- Yang , S. , Luo , P. , Loy , C.C. , and Tang , X. WIDER FACE: A Face Detection Benchmark Proceedings of the IEEE International Conference on Computer Vision IEEE 2016 5525 5533 9781467388504 10.1109/CVPR.2016.596