This content is not included in your SAE MOBILUS subscription, or you are not logged in.
Region Proposal Technique for Traffic Light Detection Supplemented by Deep Learning and Virtual Data
ISSN: 0148-7191, e-ISSN: 2688-3627
Published March 28, 2017 by SAE International in United States
Annotation ability available
In this work, we outline a process for traffic light detection in the context of autonomous vehicles and driver assistance technology features. For our approach, we leverage the automatic annotations from virtually generated data of road scenes. Using the automatically generated bounding boxes around the illuminated traffic lights themselves, we trained an 8-layer deep neural network, without pre-training, for classification of traffic light signals (green, amber, red). After training on virtual data, we tested the network on real world data collected from a forward facing camera on a vehicle. Our new region proposal technique uses color space conversion and contour extraction to identify candidate regions to feed to the deep neural network classifier. Depending on time of day, we convert our RGB images in order to more accurately extract the appropriate regions of interest and filter them based on color, shape and size. These candidate regions are fed to a deep neural network. In this paper, we focus on a region of interest (ROI) proposal method, which works to minimize false negative and false positive candidate regions that are then fed to the deep neural network for classification. This camera-only solution has applications for many levels of autonomy, from driver assistance technology (SAE Level 2) to fully automated vehicles (SAE Level 4).
CitationMoosaei, M., Zhang, Y., Micks, A., Smith, S. et al., "Region Proposal Technique for Traffic Light Detection Supplemented by Deep Learning and Virtual Data," SAE Technical Paper 2017-01-0104, 2017, https://doi.org/10.4271/2017-01-0104.
- Morten Borno Jensen, Mark Philip Philipsen, Andreas Mogelmose, Thomas Baltzer Moeslund, and Mohan Manubhai Trivedi, “Vision for Looking at Traffic Lights: Issues, -11- Survey, and Perspectives”, IEEE Transactions on Intelligent Transportation Systems. 2016; PP(99): pp. 1–16.
- John, V. Yoneda, K. Qi, B. Liu Z., and Mita S., “Traffic light recognition in varying illumination using deep learning and saliency map,” in IEEE 17th International Conference on Intelligent Transportation Systems, 2014, pp. 2286–2291
- John, V. Yoneda, K. Liu Z., and Mita S., “Saliency map generation by the convolutional neural network for real-time traffic light detection using template matching,” IEEE Transactions on Computational Imaging, vol. 1, no. 3, pp. 159–173, Sept 2015
- Davis, Jesse, and Mark Goadrich. “The relationship between Precision-Recall and ROC curves.” Proceedings of the 23rd international conference on Machine learning. ACM, 2006.
- Ciresan, U. Meier, Masci J., and Schmidhuber J., “Multi column deep neural network for traffic sign classification”. Neural Networks, 32:333–338, 2012.