This content is not included in
your SAE MOBILUS subscription, or you are not logged in.
Higher Accuracy and Lower Computational Perception Environment Based Upon a Real-time Dynamic Region of Interest
Technical Paper
2022-01-0078
ISSN: 0148-7191, e-ISSN: 2688-3627
Annotation ability available
Sector:
Language:
English
Abstract
Robust sensor fusion is a key technology for enabling the safe operation of automated vehicles. Sensor fusion typically utilizes inputs of cameras, radars, lidar, inertial measurement unit, and global navigation satellite systems, process them, and then output object detection or positioning data. This paper will focus on sensor fusion between the camera, radar, and vehicle wheel speed sensors which is a critical need for near-term realization of sensor fusion benefits. The camera is an off-the-shelf computer vision product from MobilEye and the radar is a Delphi/Aptive electronically scanning radar (ESR) both of which are connected to a drive-by-wire capable vehicle platform. We utilize the MobilEye and wheel speed sensors to create a dynamic region of interest (DROI) of the drivable region that changes as the vehicle moves through the environment. The use of the DROI can reduce the need for up to approximately 100% of the detections from radar, for processing of the driveable region. This provides not only accurate and robust detections but also has benefits in lowering computational power and time complexity. We then continue to reduce the number of detections in the driveable region using machine learning techniques such as density-based spatial clustering and applications with noise (DBSCAN). This is followed by KMeans clustering to further reduce detections and lastly fused with the extended Kalman filter. Our experimental results obtained using an instrumented vehicle show a large reduction in the need for radar detections processing after both, fusion with our DROI and further clustering using machine learning techniques for the driveable region. Our proposed complete technique decreases the amount of fused misdetection, decreases computational power, and increases the reliability of the fused perception model which can greatly benefit current Advanced Driver Assistance System products available on the market today.
Authors
Topic
Citation
Brown, N., Fanas Rojas, J., Alzu'bi, H., Alrousan, Q. et al., "Higher Accuracy and Lower Computational Perception Environment Based Upon a Real-time Dynamic Region of Interest," SAE Technical Paper 2022-01-0078, 2022, https://doi.org/10.4271/2022-01-0078.Also In
References
- Media , N. https://www.nhtsa.gov/press-releases/2020-fatality-data-show-increased-traffic-fatalities-during-pandemic 2021
- https://www.sae.org/news/press-room/2018/12/sae-international-releases-updated-visual-chart-for-its-%E2%80%9Clevels-of-driving-automation%E2%80%9D-standard-for-self-driving-vehicles
- Meng , X. , Wang , H. , and Liu , B. A Robust Vehicle Localization Approach Based on GNSS/IMU/DMI/LiDAR Sensor Fusion for Autonomous Vehicles Sensors 17 9 2017 10.3390/s17092140
- Stahl , T. , Wischnewski , A. , Betz , J. , and Lienkamp , M. ROS-Based Localization of a Race Vehicle at High-Speed Using LIDAR E3S Web Conf. 95 04002 2019 10.1051/e3sconf/20199504002
- Marin-Plaza , P. , Hussein , A. , Martin , D. Global and Local Path Planning Study in a ROS-Based Research Platform for Autonomous Vehicles Journal of Advanced Transportation 2018 2018 10.1155/2018/6392697
- Chu , K. , Lee , M. , and Sunwoo , M. Local Path Planning for Off-Road Autonomous Driving With Avoidance of Static Obstacles IEEE Trans. Intell. Transp. Syst. 13 4 1599 1616 2012 10.1109/TITS.2012.2198214
- Zhao , J. , Hu , Y. , Muldoon , S. , and Chang , C. ‘InfoRich’ Eco-Driving Control Strategy for Connected and Automated Vehicles 2019 American Control Conference (ACC), ieeexplore.ieee.org 4621 4627 2019 10.23919/ACC.2019.8814727
- SAE International Nov 2017
- Maddern , W. and Newman , P. Real-Time Probabilistic Fusion of Sparse 3D LIDAR and Dense Stereo 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), ieeexplore.ieee.org 2181 2188 2016 10.1109/IROS.2016.7759342
- Kim , T. and Park , T.-H. Extended Kalman Filter (EKF) Design for Vehicle Position Tracking Using Reliability Function of Radar and Lidar Sensors 20 15 2020 10.3390/s20154126
- Shahian Jahromi , B. , Tulabandhula , T. , and Cetin , S. Real-Time Hybrid Multi-Sensor Fusion Framework for Perception in Autonomous Vehicles Sensors 19 20 2019 10.3390/s19204357
- Akram , M.A. , Liu , P. , Tahir , M.O. , Ali , W. , and Wang , Y. A State Optimization Model Based on Kalman Filtering and Robust Estimation Theory for Fusion of Multi-Source Information in Highly Non-linear Systems Sensors 19 7 2019 10.3390/s19071687
- Egerstedt , M. and Martin , C. Control Theoretic Splines: Optimal Control, Statistics, and Path Planning Princeton University Press 2009 9781400833870
- Du , J. Understanding of Object Detection Based on CNN Family and YOLO J. Phys. Conf. Ser. 1004 1 012029 2018 10.1088/1742-6596/1004/1/012029
- Huang , R. , Pedoeem , J. , and Chen , C. YOLO-LITE: A Real-Time Object Detection Algorithm Optimized for Non-GPU Computers 2018 IEEE International Conference on Big Data (Big Data), ieeexplore.ieee.org 2503 2510 2018 10.1109/BigData.2018.8621865
- Qian , Y. , Dolan , J.M. , and Yang , M. DLT-Net: Joint Detection of Drivable Areas, Lane Lines, and Traffic Objects IEEE Trans. Intell. Transp. Syst. 21 11 4670 4679 2020 10.1109/TITS.2019.2943777
- Jacobs , L. , Weiss , J. , and Dolan , D. Object Tracking in Noisy Radar Data: Comparison of Hough Transform and RANSAC IEEE International Conference on Electro-Information Technology, EIT 2013, ieeexplore.ieee.org 1 6 2013 10.1109/EIT.2013.6632715
- Syarif , I. , Prugel-Bennett , A. , and Wills , G. Unsupervised Clustering Approach for Network Anomaly Detection Networked Digital Technologies Springer Berlin Heidelberg 135 145 2012 10.1007/978-3-642-30507-8_13
- Sinaga , K.P. and Yang , M.-S. Unsupervised K-Means Clustering Algorithm IEEE Access 8 2020 80716 80727 10.1109/ACCESS.2020.2988796
- Yan , J. , Yuan , D. , Xing , X. , and Jia , Q. Kalman Filtering Parameter Optimization Techniques Based on Genetic Algorithm 2008 IEEE International Conference on Automation and Logistics, ieeexplore.ieee.org 1717 1720 2008 10.1109/ICAL.2008.4636432
- http://web.mit.edu/kirtley/kirtley/binlustuff/literature/control/Kalman%20filter.pdf 2021
- http://docs.ros.org/en/melodic/api/robot_localization/html/index.html 2021
- Delphi ESR https://autonomoustuff.atlassian.net/wiki/spaces/RW/pages/17509820/Delphi+ESR Sep. 2021
- Dong , G. , Jin , Y. , Wang , S. , Li , W. et al. DB-Kmeans:An Intrusion Detection Algorithm Based on DBSCAN and K-means 2019 20th Asia-Pacific Network Operations and Management Symposium (APNOMS), ieeexplore.ieee.org 1 4 2019 10.23919/APNOMS.2019.8892910
- Khan , K. , Rehman , S.U. , Aziz , K. , Fong , S. et al. DBSCAN: Past, Present and Future The Fifth International Conference on the Applications of Digital Information and Web Technologies (ICADIWT 2014), ieeexplore.ieee.org 232 238 2014 10.1109/ICADIWT.2014.6814687
- Peng , K. , Leung , V.C.M. , and Huang , Q. Clustering Approach Based on Mini Batch Kmeans for Intrusion Detection System Over Big Data IEEE Access 6 11897 11906 2018 10.1109/ACCESS.2018.2810267
- Robert , C. and Casella , G. Monte Carlo Statistical Methods 9781475730715 Springer Science & Business Media 2013
- Vermaak , J. , Godsill , S.J. , and Perez , P. Monte Carlo Filtering for Multi Target Tracking and Data Association IEEE Trans. Aerosp. Electron. Syst. 41 1 309 332 2005 10.1109/TAES.2005.1413764
- Zhang , T. , Xu , C. , and Yang , M.-H. Multi-Task Correlation Particle Filter for Robust Object Tracking Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, openaccess.thecvf.com 4335 4343 2017
- Zhang , T. , Liu , S. , Xu , C. , Liu , B. , and Yang , M.-H. Correlation Particle Filter for Visual Tracking IEEE Trans. Image Process. 27 6 2676 2687 2018 10.1109/TIP.2017.2781304
- Ullah , I. , Shen , Y. , Su , X. , Esposito , C. et al. A Localization Based on Unscented Kalman Filter and Particle Filter Localization Algorithms IEEE Access 8 2020 2233 2246 10.1109/ACCESS.2019.2961740
- https://www.sae.org/standards/content/j2400_200308/
- https://www.sae.org/standards/content/j2399_200312/
- Li , H. and Kim , J. Characterisation of the Delphi Electronically Scanning Radar for Robotics Applications Li , H. and Kim , J. Australian Robotics and Automation Association Australia 2015 1 10