This content is not included in
your SAE MOBILUS subscription, or you are not logged in.
Multi-target Tracking Algorithm with Adaptive Motion Model for Autonomous Urban Driving
Technical Paper
2020-01-5167
ISSN: 0148-7191, e-ISSN: 2688-3627
This content contains downloadable datasets
Annotation ability available
Sector:
Event:
Automotive Technical Papers
Language:
English
Abstract
Since situational awareness is crucial for autonomous driving in urban environments, multi-target tracking has become an increasingly popular research topic during the last several years. For autonomous driving in urban environments, cars and pedestrians are the two main types of obstacles, and their motion characteristics are not the same. While in the current related multi-target tracking research, the same motion model (such as Constant Velocity model [CV]) or motion model set (such as CV combined with Constant Acceleration model [CA]) is mostly used to track different types of obstacles simultaneously. Besides, in current research, regular motion models are mostly adopted to track pedestrians, such as CV, CA, and so on, the uncertainty in pedestrian motion is not well considered. If the motion characteristics of different types of obstacles cannot be accurately modeled, the performance of the target tracking algorithm will be degraded, which will lead to errors in the following decision-making and motion planning algorithm. To solve the above problems, this paper uses the Interacting Multiple Model (IMM) method to describe obstacles’ different motion characteristics in different motion stages. Multiple different motion models are simultaneously used to describe the motion of obstacles to make it as close as possible to the actual situation. Furthermore, due to different motion characteristics of cars and pedestrians, by using a data set, the analysis is carried out to obtain the motion model set for car tracking and that for pedestrian tracking, respectively. Then combined with the IMM algorithm, the two-step adaptation of the target’s motion model during the tracking process is realized based on object class information: motion model set adaptation and motion model weight adaptation. The number of motion models included in the motion model set for target tracking is also reduced, which reduces the calculation amount of the algorithm. For the uncertainty in pedestrian motion, Random Motion (RM) model is introduced to improve the algorithm performance in pedestrian tracking. The effectiveness of the proposed algorithm is verified through experiments on a data set, it achieves 85.99% in Multiple Object Tracking Accuracy (MOTA), 75.06% in Multiple Object Tracking Precision (MOTP), 85.03% in Mostly Tracked (MT), and 4.10% in Mostly Lost (ML), and the average time for the algorithm to process one frame of data is 12.05 ms.
Topic
Citation
Su, J., Chen, H., and Yang, Q., "Multi-target Tracking Algorithm with Adaptive Motion Model for Autonomous Urban Driving," SAE Technical Paper 2020-01-5167, 2020, https://doi.org/10.4271/2020-01-5167.Data Sets - Support Documents
Title | Description | Download |
---|---|---|
Unnamed Dataset 1 | ||
Unnamed Dataset 2 | ||
Unnamed Dataset 3 | ||
Unnamed Dataset 4 |
Also In
References
- Blackman , S. and Popoli , R. Design and Analysis of Modern Tracking Systems Boston Artech House 1999
- Blackman , S. Multiple Hypothesis Tracking for Multiple Target Tracking IEEE Aerospace and Electronic Systems Magazine 5 18 2004 https://doi.org/10.1109/MAES.2004.1263228
- Werthmann , J.R. Step-by-Step Description of a Computationally Efficient Version of Multiple Hypothesis Tracking Signal and Data Processing of Small Targets Orlando, FL 1992 https://doi.org/10.1117/12.139379
- Baig , Q. , Aycard , O. , Vu , T.D. , and Fraichard , T. Fusion Between Laser and Stereo Vision Data for Moving Objects Tracking in Intersection Like Scenario IEEE Intelligent Vehicles Symposium Baden-Baden, Germany June 5-9, 2011 https://doi.org/10.1109/IVS.2011.5940576
- Vo , B.-N. , Mahendra , M. , Bar-Shalom , Y. , Stefano , C. et al. Multitarget Tracking Wiley Encyclopedia of Electrical and Electronics Engineering Chichester Wiley 2015
- Vaquero , V. , Ely , R. , and Alberto , S. Robust and Real-Time Detection and Tracking of Moving Objects with Minimum 2D Lidar Information to Advance Autonomous Cargo Handling in Ports Sensors 19 1 107 2019 https://doi.org/10.3390/s19010107
- Kalman , R.E. A New Approach to Linear Filtering and Prediction Problems Journal of Basic Engineering 82 1 35 45 1960 https://doi.org/10.1115/1.3662552
- Einicke , G.A. and White , L.B. Robust Extended Kalman Filtering IEEE Transactions on Signal Processing 47 9 2596 2599 1999 https://doi.org/10.1109/78.782219
- Julier , S.J. and Uhlmann , J.K. Unscented Filtering and Nonlinear Estimation Proceedings of the IEEE 92 3 401 422 2004 https://doi.org/10.1109/JPROC.2003.823141
- Abdul Rachman , A.S. 2017
- Arulampalam , M.S. , Maskell , S. , Gordon , N. , and Clapp , T. A Tutorial on Particle Filters for Online Nonlinear/Non-Gaussian Bayesian Tracking IEEE Transactions on Signal Processing 50 2 174 188 2002 https://doi.org/10.1109/78.978374
- Li , X.R. and Jilkov , V.P. Survey of Maneuvering Target Tracking. Part I. Dynamic Models IEEE Transactions on Aerospace and Electronic Systems 39 4 1333 1364 2003 https://doi.org/10.1109/TAES.2003.1261132
- Weng , X. and Kitani , K.M. A Baseline for 3D Multi-Object Tracking arXiv:1907.03961 2019
- Andreas , G. , Lenz , P. , and Urtasun , R. Are We Ready for Autonomous Driving the Kitti Vision Benchmark Suite IEEE Conference on Computer Vision and Pattern Recognition Providence, RI June 16-21, 2012 https://doi.org/10.1109/CVPR.2012.6248074
- Ye , Y. , Fu , L. , and Li , B. Object Detection and Tracking Using Multi-Layer Laser for Autonomous Urban Driving IEEE 19th International Conference on Intelligent Transportation Systems Rio de Janeiro, Brazil Nov. 1-4, 2016 https://doi.org/10.1109/ITSC.2016.7795564
- Zhai , G. , Meng , H. , and Wang , X. A Constant Speed Changing Rate and Constant Turn Rate Model for Maneuvering Target Tracking Sensors 14 3 5239 5253 2014 https://doi.org/10.3390/s140305239
- Liu , J. , Wang , Z. , and Xu , M. DeepMTT: A Deep Learning Maneuvering Target-Tracking Algorithm Based on Bidirectional LSTM Network Information Fusion 53 289 304 2020 https://doi.org/10.1016/j.inffus.2019.06.012
- Sualeh , M. and Kim , G.-W. Dynamic Multi-Lidar Based Multiple Object Detection and Tracking Sensors 19 6 1474 2019 https://doi.org/10.3390/s19061474
- Kim , B. , Yi , K. , Yoo , H.-J. , Chong , H.-J. et al. An IMM/EKF Approach for Enhanced Multitarget State Estimation for Application to Integrated Risk Management System IEEE Transactions on Vehicular Technology 64 3 876 889 2015 https://doi.org/10.1109/TVT.2014.2329497
- Madrigal , F. and Hayet , J.-B. Evaluation of Multiple Motion Models for Multiple Pedestrian Visual Tracking 10th IEEE International Conference on Advanced Video and Signal Based Surveillance Krakow, Poland Aug. 27-30, 2013 https://doi.org/10.1109/AVSS.2013.6636612
- Schreier , M. , Willert , V. , and Adamy , J. Compact Representation of Dynamic Driving Environments for Adas by Parametric Free Space and Dynamic Object Maps IEEE Transactions on Intelligent Transportation Systems 17 2 367 384 2016 https://doi.org/10.1109/TITS.2015.2472965
- Patil , A. , Malla , S. , Gang , H. , and Chen , Y.-T. The H3D Dataset for Full-Surround 3D Multi-Object Detection and Tracking in Crowded Urban Scenes International Conference on Robotics and Automation Montreal, Canada May 20-24, 2019 https://doi.org/10.1109/ICRA.2019.8793925
- Mazor , E. , Aberbuch , A. , Bar-Shalom , Y. , and Dayan , J. Interacting Multiple Model Methods in Target Tracking: A Survey IEEE Transactions on Aerospace and Electronic Systems 34 1 103 123 1998 https://doi.org/10.1109/7.640267
- Bernardin , K. and Stiefelhagen , R. Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics EURASIP Journal on Image and Video Processing 2008 1 10 2008 https://doi.org/10.1155/2008/246309
- Yuan , L. , Huang , C. , and Nevatia , R. Learning to Associate: Hybridboosted Multi-Target Tracker for Crowded Scene IEEE Conference on Computer Vision and Pattern Recognition Miami, FL June 20-25, 2009 https://doi.org/10.1109/CVPR.2009.5206735
- Anton , M. , Leal-Taixe , L. , Reid , I. , Roth , S. et al. MOT16: A Benchmark for Multi-Object Tracking arXiv:1603.00831 2016
- Marco , A. , Broggi , A. , Giaquinto , D. , Patander , M. et al. Machine Learning in Tracking Associations with Stereo Vision and Lidar Observations for an Autonomous Vehicle IEEE Intelligent Vehicles Symposium Gothenburg, Sweden June 19-22, 2016 https://doi.org/10.1109/IVS.2016.7535456
- Aljoša , O. , Mehner , W. , Mathias , M. , and Leibe , B. Combined Image- and World-Space Tracking in Traffic Scenes IEEE International Conference on Robotics and Automation (ICRA) Singapore May 29- June 3, 2017 https://doi.org/10.1109/ICRA.2017.7989230