This content is not included in your SAE MOBILUS subscription, or you are not logged in.
Multi-Sensor Information Fusion for Determining Road Quality for Semi-Autonomous Vehicles
ISSN: 0148-7191, e-ISSN: 2688-3627
Published October 05, 2022 by SAE International in United States
Annotation ability available
Pothole detection in Intelligent Transportation Systems (ITS) vehicles has been a part of Advanced driver-assistance systems (ADAS) for a long time. Various sensors have been used for this purpose so far: Accelerometer, Gyroscope, etc. However, the fusion of multiple modalities of information from different sensors remains a challenge, mainly owing to the different sampling rates and varying frame rates used by each sensor. Other sensor types like Radar and LIDAR, though precise, are difficult to use, thus forcing us to look for low-cost solutions. Our proposed work uses Accelerometer and Gyroscope sensor fusion to predict pothole presence in Indian scenarios. Previous works have mainly dealt with predicting potholes with data collected using either traditional machine learning techniques like Decision trees, (Support Vector Machines (SVM)’s and Light Gradient Boosting Machine (LGBM) and deep learning methods using neural networks and attention mechanisms. In this work, the main focus is on using Convolution Neural Network-based methods to extract information from the sensor data after appropriate preprocessing. Notably, time series models such as Long Short-Term Memory (LSTM), Gated Recurrent Unit (GRU), and Transformers integrated with lightweight attention units are then used to classify and predict the presence of potholes based on the information extracted. Further, different classes of neural networks and transformers like Involution Neural networks are investigated for reliable predictions. Subsequently, this information is used to predict potholes and may be used to develop a Road Quality index for Indian Roads which will indicate the quality of a given stretch of road. This paper demonstrates how the proposed method would provide greater accuracy for the prediction of potholes when a vehicle passes through a particular road.
CitationBhar, T., Venkataraman, H., and Nidamanuri, J., "Multi-Sensor Information Fusion for Determining Road Quality for Semi-Autonomous Vehicles," SAE Technical Paper 2022-28-0004, 2022, https://doi.org/10.4271/2022-28-0004.
- Ministry of Road Transport and Highways, Government of India Ministry of Road Transport & Highways, Government of India https://morth.nic.in/
- Ahmed , K.R. Smart Pothole Detection Using Deep Learning Based on Dilated Convolution Sensors 21 24 2021 8406 https://doi.org/10.3390/s21248406
- Bhatt , U. , Mani , S. , Xi , E. , and Zico Kolter , J. Intelligent Pothole Detection and Road Condition Assessment arXiv.org 2017 https://arxiv.org/abs/1710.02595
- Wang , Z. , Yan , W. , and Oates , T. 2016 https://arxiv-export-lb.library.cornell.edu/abs/1611.06455v2
- Zhang , J. et al. Attention-Based Convolutional and Recurrent Neural Networks for Driving Behavior Recognition Using Smartphone Sensor Data IEEE Access 7 2019 148031 148046 10.1109/ACCESS.2019.2932434
- Pawar , K. , Jagtap , S. , and Bhoir , S. Efficient Pothole Detection using Smartphone Sensors ITM Web of Conferences. 32 2020 03013 10.1051/itmconf/20203203013
- Nidamanuri , J. et al. Auto-Alert: A Spatial and Temporal Architecture for Driving Assistance in Road Traffic Environments International Journal of Intelligent Transportation Systems Research 20 2022 64 74 https://doi.org/10.1007/s13177-021-00272-3
- Nidamanuri , J. , Mukherjee , P. , Assfalg , R. , and Venkataraman , H. Dual-V-sense-Net (DVN): Multi-sensor Recommendation Engine for Distraction Analysis and Chaotic Driving Conditions IEEE Sensors Journal 2022 10.1109/JSEN.2022.3184983
- Li , D. , Hu , J. , Wang , C. , Li , X. et al. arXiv.org 2021 https://arxiv.org/abs/2103.06255
- O’Malley , T. , Bursztein , E. , Long , J. , Chollet , F. et al. KerasTuner 2019 https://github.com/keras-team/keras-tuner