This content is not included in your SAE MOBILUS subscription, or you are not logged in.
A Hybrid Method for Stereo Vision-Based Vehicle Detection in Urban Environment
ISSN: 0148-7191, e-ISSN: 2688-3627
Published September 23, 2017 by SAE International in United States
This content contains downloadable datasetsAnnotation ability available
Vehicle detection has been a fundamental problem in the research of Intelligent Traffic System (ITS), especially in urban driving environment. Over the past decades, vision-based vehicle detection has got a considerable attention. In addition to the rich appearance information, the stereo vision method also provides depth information, which could achieve higher accuracy and precision. In this paper, a hybrid method for stereo vision-based real-time vehicle detection in urban environment is proposed. Firstly, we extract vehicle features and generate the Region of Interest (ROI). Semi-global Matching (SGM) algorithm is then utilized on the ROIs to generate disparity maps and get the depth information, which could be used to compute the width of each ROI. The noise regions, always with obvious depth variation in the disparity maps are excluded by the clustering approach. Finally, we use Histogram of Oriented Gradient (HOG) feature and Support Vector Machine (SVM) to verify the final vehicles in the candidate sets. To optimize the system further, we lead in the multi-scale classifier with the detection accuracy increasing dramatically. Experimental results show that the proposed method could achieve more than 20 fps in urban environment and the system could effectively remove the interference caused by trees, guardrails and buildings, which demonstrate its good application prospect. Further, our method can be applied to ADAS on the collision warning system and active braking system for front obstacle detection.
CitationLi, W., Li, W., Liu, J., and Chen, Y., "A Hybrid Method for Stereo Vision-Based Vehicle Detection in Urban Environment," SAE Technical Paper 2017-01-1975, 2017, https://doi.org/10.4271/2017-01-1975.
Data Sets - Support Documents
|[Unnamed Dataset 1]|
|[Unnamed Dataset 2]|
|[Unnamed Dataset 3]|
- Sivaraman, S., and Trivedi, M, M., “Looking at Vehicles on the Road: A Survey of Vision-Based Vehicle Detection, Tracking, and Behavior Analysis,” IEEE T. Intell. Transp. 14(4):1773-1795, 2013.
- Arenado, M, I., Oria, J, M, P., Torre-Ferrero, C., and Renteria, L., “Monovision-based vehicle detection, distance and relative speed measurement in urban traffic,” IET Intell. Transp. Syst. 8(8):655-664, 2014.
- Niknejad, H, T., Takeuchi, A., Mita, S., and McAllester, D., “On-Road Multivehicle Tracking Using Deformable Object Model and Particle Filter with Improved Likelihood Estimation,” IEEE T. Intell. Transp. 13(2):748-758, 2012.
- Sivaraman, S., and Trivedi, M, M., “A general active-learning framework for on-road vehicle recognition and tracking,” IEEE Trans. Intell. Transp. Syst. 11(2):267-276, 2010.
- Sun, Z., Bebis, G., and Miller, R., “Monocular Precrash vehicle detection: features and classifiers,” IEEE Trans. Image Process. 15:2019-2034, 2006.
- Jazayeri, A., Cai, H., Zheng, J, Y., and Tuceryan, M., “Vehicle Detection and Tracking in Car Video Based on Motion Model,” IEEE Trans. Intell. Transp. Syst. 12(2):583-595, 2011.
- Cao, Y., Renfrew, A., and Cook, P., “Vehicle motion analysis based on a monocular vision system,” presented at IET RTIC and ITS United Kingdom Members’ Conf., 1-6, 2008.
- Labayrade, R., Aubert, D., and Tarel, J, P., “Real time obstacle detection in stereovision on non-flat road geometry through ‘v-disparity’ representation,” Intelligent Vehicle Symposium, (2):646-651, 2002.
- Kowsari T., Beauchemin. S. S., and Cho. J, “Real-time vehicle detection and tracking using stereo vision and multi-view AdaBoost,” IEEE Intell. Intell. Transp. Syst. 1255-1260, 2011.
- Hermes, C., Einhaus. J., Hahn. M., Wöhler, C. et al., “Vehicle tracking and motion prediction in complex urban scenarios,” Intelligent Vehicles Symposium. 26-33, 2010.
- Mori, H., and Charkari, N., “Shadow and rhythm as sign patterns of obstacle detection,” IEEE Int. Symposium on Industrial Electronics. Budapest, Hungary, June 1993, pp. 271-277
- Hirschmuller, H., “Accurate and Efficient Stereo Processing by Semi-Global Matching and Mutual Information,” IEEE Computer Society Conf. on Computer Vision and Pattern Recognition (CVPR), San Diego. U.S.A., June, 2005, pp. 807-814.
- Hirschmuller, H. “Stereo Processing by Semiglobal Matching and Mutual Information,” IEEE T. Pattern. Anal. 30, pp. 328-341, 2008.
- Birchfield, S., and Tomasi, C., “Depth Discontinuities by Pixel-to-Pixel Stereo,” Int. J. Comput. Vision. 35(3):269-293, 1999.
- Chan, Y, M., Huang, S, S., Fu, L, C., Hsiao, P, Y. et al., “Vehicle detection and tracking under various lighting conditions using a particle filter,” IET Intell. Transp. Syst. 6(1):1-8, 2012.
- Triggs, B., and Dalal, N., “Histograms of Oriented Gradients for Human Detection,” IEEE Computer Society Conf. on Computer Vision and Pattern Recognition (CVPR). San Diego, California, June 2005, pp. 886-893.
- Zhu, Q., Yeh, M, C., Cheng, K, T., Avidan, S., “Fast Human Detection Using a Cascade of Histograms of Oriented Gradients,” IEEE Computer Society Conf. on Computer Vision and Pattern Recognition (CVPR). New York, June 2006, pp. 1491-1498.
- Suard, F., Rakotomamonjy, A., and Bensrhair, A., “Pedestrian Detection using Infrared images and Histograms of Oriented Gradients,” IEEE Int. Veh. Sym. pp. 206-212, 2006.
- Lee, S, H., Bang, M., and Jung, K, H., and Yi, K., “An efficient selection of HOG feature for SVM classification of vehicle,” Inter. Symp. Consum. Electr (ISCE). pp. 1-2, 2015.
- Cortes, C., and Vapnik, V., “Support-Vector Networks,” Mach. Learn. 20(3):273-297, 1995.
- Geiger, A., Urtasun, R., and Lenz, P., “Are we ready for autonomous driving? The KITTI vision benchmark suite,” IEEE Conf. on Computer Vision and Pattern Recognition (CVPR). Providence, RI USA, June 2012, pp. 3354-3361.
- Huang, Y., Liu, S., “Multi-class obstacle detection and classification using stereovision and improved active contour models,” IET Intelligent Transport Systems, 10(3):197-205, 2016.
- Li, X., Guo, X., “Vision-Based Method for Forward Vehicle Detection and Tracking,” Inter. Conf. on Mechanical and Automation Engineering, Washington, USA, July 2013, pp. 128-131.
- Wen, X., Shao, L., Fang, W., et al. “Efficient Feature Selection and Classification for Vehicle Detection,” IEEE Transactions on Circuits and Systems for Video Technology, 25(3):508-517, 2015.
- Kowsari, T., Beauchemin, S, S., Cho, J., “Real-time vehicle detection and tracking using stereo vision and multi-view AdaBoost,” Inter. Conf. on Intelligent Transportation Systems, 2011, pp.1255-1260.