This content is not included in your SAE MOBILUS subscription, or you are not logged in.
Detection of Potholes and Speedbumps by Monitoring Front Traffic
ISSN: 0148-7191, e-ISSN: 2688-3627
Published April 24, 2019 by SAE International in United States
This content contains downloadable datasetsAnnotation ability available
Event: Automotive Technical Papers
This article proposes a novel method for detecting potholes and speed bumps by monitoring the front traffic when the road is not visibly seen. The existing camera-based systems in the car directly scan the road surface and estimate the road profile. The main disadvantage of the current technology is that it is not possible to detect the road profile when the road is not clearly visible. This can happen in situations when roads are waterlogged or have occluded bumps and in low light conditions. In thisarticle, the proposed method for detecting potholes or speed bumps by monitoring the vertical movement of the front traffic can enhance the existing algorithm by overcoming the abovementioned disadvantage. However, the method works only when there is traffic ahead of the system vehicle. The method makes level 3 and above autonomous driving more robust in terms of comfort and safety by estimating the road profile in the abovementioned road conditions. The method uses an object localization algorithm and optical flow to determine the motion vectors of vehicles. The histogram of motion vectors in the vertical direction is calculated and its weighted average is obtained for each frame. As a feature extraction process, fast Fourier transform (FFT) is applied to the fixed size queue buffer containing weighted average values to obtain the frequency spectrum, which is used as a feature set for classification. After feature selection, the support vector machine (SVM) is used to classify whether a pothole/road bump has been detected. Apart from hardware video stabilization, the same classification procedure is applied to static objects in the frame, and camera egomotion is detected. This is done to avoid false positives due to camera movement when the system vehicle is moving over a pothole or a speed bump. The developed algorithm is validated with the manually collected dataset and the results and the analysis are presented here.
CitationNagarajan, K. and Jindal, A., "Detection of Potholes and Speedbumps by Monitoring Front Traffic," SAE Technical Paper 2019-01-5031, 2019, https://doi.org/10.4271/2019-01-5031.
Data Sets - Support Documents
|Unnamed Dataset 1|
|Unnamed Dataset 2|
|Unnamed Dataset 3|
- Chen , H.T. , Lai , C.Y. , Hsu , C.C. , Lee , S.Y. et al. Vision-Based Road Bump Detection Using a Front-Mounted Car Camcorder 2014 22nd International Conference on Pattern Recognition Stockholm 2014 4537 4542 10.1109/ICPR.2014.776
- Madli , R. , Hebbar , S. , Pattar , P. , and Prasad , G.V. Automatic Detection and Notification of Potholes and Humps on Roads to Aid Drivers IEEE Sensors Journal 15 1 1 2015 10.1109/JSEN.2015.2417579
- Lamża , A. and Wróbel , Z. New Efficient Method of Digital Video Stabilization for In-Car Camera Springer Berlin Heidelberg 2012 10.1007/978-3-642-30721-8_18
- Mednis , A. , Strazdins , G. , Zviedris , R. , Kanonirs , G. et al. Real Time Pothole Detection Using Android Smartphones with Accelerometers 7th IEEE International Conference on Distributed Computing 1 6 2011 10.1109/DCOSS.2011.5982206
- Akagic , A. , Buza , E. , and Omanovic , S. 2017 10.23919/MIPRO.2017.7973589
- Cubero-Fernandez , A. , Rodriguez-Lozano , F.J. , Villatoro , R. , Olivares , J. et al. Efficient Pavement Crack Detection and Classification EURASIP Journal on Image and Video Processing 2017 10.1186/s13640-017-0187-0
- Udacity https://github.com/udacity/self-driving-car/tree/master/datasets
- Geiger , A. , Lenz , P. , Stiller , C. , and Urtasun , R. Vision Meets Robotics: The KITTI Dataset International Journal of Robotics Research (IJRR) 2013
- Cordts , M. , Omran , M. , Ramos , S. , Rehfeld , T. et al. The Cityscapes Dataset for Semantic Urban Scene Understanding Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2016
- Car Sim (Version 2018.0)
- Redmon , J. and Farhadi , A. 2018
- Farnebäck , G. Two-Frame Motion Estimation Based on Polynomial Expansion Springer Berlin Heidelberg 2003 363 370 10.1007/3-540-45103-X_50
- Chaudhry , R. , Ravichandran , A. , Hager , G. , and Vidal , R. Histograms of Oriented Optical Flow and Binet-Cauchy Kernels on Nonlinear Dynamical Systems for the Recognition of Human Actions 2009 IEEE Conference on Computer Vision and Pattern Recognition Miami, FL 2009 1932 1939 10.1109/CVPR.2009.5206821
- Pedregosa , F. , Varoquaux , G. , Gramfort , A. , Michel , V. et al. Scikit-Learn: Machine Learning in Python Journal of Machine Learning Research 12 2825 2830 2011
- Mago , V.K. and Nitin Bhatia , N. 2011 299 10.4018/978-1-61350-429-1
- McInnes , L. and Healy , J.
- Wang , H. and Schmid , C. Action Recognition with Improved Trajectories ICCV - IEEE International Conference on Computer Vision Sydney, Australia 2013 IEEE 3551 3558 10.1109/ICCV.2013.441
- Woods , R.E. Digital Image Processing Using MATLAB Electronic Industry Press 2008 7
- He , K. , Gkioxari , G. , Dollar , P. , and Girshick , R 2017
- Zhang , J. , Huang , K. , Yu , Y. , and Tan , T. Boosted Local Structured HOG-LBP for Object Localization CVPR 2011 Providence, RI 2011 1393 1400 10.1109/CVPR.2011.5995678
- Salman , Y.D. , Ku-Mahamud , K.R. , and Kamioka , E. Distance Measurement for Self-Driving Cars Using Stereo Camera Zulikha , J. and Zakaria , N.H. Proceedings of the 6th International Conference of Computing & Informatics 235 242 2017