This content is not included in
your SAE MOBILUS subscription, or you are not logged in.
Object Detection and Tracking for Autonomous Vehicles in Adverse Weather Conditions
Technical Paper
2021-01-0079
ISSN: 0148-7191, e-ISSN: 2688-3627
This content contains downloadable datasets
Annotation ability available
Sector:
Event:
SAE WCX Digital Summit
Language:
English
Abstract
Object detection and tracking is a central aspect of perception for autonomous vehicles. While there has been significant development in this field in recent years, many perception algorithms still struggle to provide reliable information in challenging weather conditions which include night-time, direct sunlight, glare, fog, etc. To achieve full autonomy, there is a need for a robust perception system capable of handling such challenging conditions. In this paper, we attempt to bridge this gap by proposing an algorithm that combines the strength of automotive radars and infra-red thermal cameras. We show that these sensors complement each other well and provide reliable data in poor visibility conditions. We demonstrate the advantages of a thermal camera over a visible-range camera in these situations and employ YOLOv3 for object detection. The proposed system utilizes a modified Track-Oriented Multiple Hypothesis Tracking (MHT) algorithm which uses data from these sensors to keep track of the surrounding vehicles. The modifications in the well-known MHT algorithm were introduced in order to curb the exponential growth of possible hypotheses and consequently reduce the computational time without loss of any critical information. To validate the system, we provide a real-time implementation on an urban dataset collected at the Texas A&M University.
Recommended Content
Authors
Topic
Citation
Bhadoriya, A., Vegamoor, V., and Rathinam, S., "Object Detection and Tracking for Autonomous Vehicles in Adverse Weather Conditions," SAE Technical Paper 2021-01-0079, 2021, https://doi.org/10.4271/2021-01-0079.Data Sets - Support Documents
Title | Description | Download |
---|---|---|
Table 1 |
Also In
References
- Balke , K.N. , Chaudhary , N.A. , Sunkari , S.R. , Charara , H.A. , Florence , D. , Stevens , C. , Pesti , G. , Tydlacka , J.M. et al. 2017
- Brijs , S. , Hermans , E. , Brijs , T. , Stiers , T. , and Offermans , C. 2007
- Schoettle , B. 2017
- Judd , K.M. , Thornton , M.P. , and Richards , A.A. Automotive Sensing: Assessing the Impact of fog on LWIR, MWIR, SWIR, Visible, and Lidar Performance Infrared Technology and Applications XLV, vol. 11002 of Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series 110021F May 2019
- Kutila , M. , Pyykonen , P. , Holzhuter , H. , Colomb , M. , and Duthon , P. Automotive Lidar Performance Verification in Fog and Rain 1695 1701 2018
- Blackman , S.S. Multiple Hypothesis Tracking for Multiple Target Tracking IEEE Aerospace and Electronic Systems Magazine 19 1 5 18 2004
- Pfeuffer , A. and Dietmayer , K. Robust Semantic Segmentation in Adverse Weather Conditions by Means of Sensor Data Fusion 2019 22th International Conference on Information Fusion (FUSION) IEEE 2019
- Wang , J.-G. , Chen , S.J. , Zhou , L.-B. , Wan , K.-W. , and Yau , W.-Y. Vehicle Detection and Width Estimation in Rain by Fusing Radar and Vision 2018 15th International Conference on Control, Automation, Robotics and Vision (ICARCV) 1063 1068 IEEE 2018
- Takumi , K. , Watanabe , K. , Ha , K. , Tejero-De-Pablos , A. et al. Multispectral Object Detection for Autonomous Vehicles Proceedings of the on Thematic Workshops of ACM Multimedia 2017 35 43 2017
- Reid , D. An Algorithm for Tracking Multiple Targets IEEE Transactions on Automatic Control 24 6 843 854 1979
- Bar-Shalom , Y. and Tse , E. Tracking in a Cluttered Environment with Probabilistic Data Association Automatica 11 5 451 460 1975
- Morefield , C. Application of 0-1 Integer Programming to Multitarget Tracking Problems IEEE Transactions on Automatic Control 22 3 302 312 1977
- Botha , F.J. , van Daalen , C.E. , and Treurnicht , J. Data Fusion of Radar and Stereo Vision for Detection and Tracking of Moving Objects 2016 Pattern Recognition Association of South Africa and Robotics and Mechatronics International Conference (PRASA-RobMech) 1 7 IEEE 2016
- Konstantinova , P. , Udvarev , A. , and Semerdjiev , T. A Study of a Target Tracking Algorithm Using Global Nearest Neighbor Approach Proceedings of the International Conference on Computer Systems and Technologies (CompSysTech’03) 290 295 2003
- Fortmann , T.E. , Bar-Shalom , Y. , and Scheffe , M. Multi-Target Tracking Using Joint Probabilistic Data Association 1980 19th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes 807 812 IEEE 1980
- Cox , I.J. and Hingorani , S.L. An Efficient Implementation of Reid’s Multiple Hypothesis Tracking Algorithm and Its Evaluation for the Purpose of Visual Tracking IEEE Transactions on Pattern Analysis and Machine Intelligence 18 2 138 150 1996
- FLIR 2019
- Fitzgerald , R.J. Track Biases and Coalescence with Probabilistic Data Association IEEE Transactions on Aerospace and Electronic Systems 6 822 825 1985
- Kim , C. , Li , F. , Ciptadi , A. , and Rehg , J.M. Multiple Hypothesis Tracking Revisited Proceedings of the IEEE International Conference on Computer Vision 4696 4704 2015
- Bernardin , K. and Stiefelhagen , R. Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics EURASIP Journal on Image and Video Processing 2008 1 10 2008