This content is not included in
your SAE MOBILUS subscription, or you are not logged in.
A Compressed Sensing and Sparsity Based Approach for Estimating an Equivalent NIR Image from a RGB Image
Technical Paper
2015-01-0310
ISSN: 0148-7191, e-ISSN: 2688-3627
Annotation ability available
Sector:
Language:
English
Abstract
Camera sensors that are made of silicon photodiodes and used in ordinary digital cameras are sensitive to visible as well as Near-Infrared (NIR) wavelength. However, since the human vision is sensitive only in the visible region, a hot mirror/infrared blocking filter is used in cameras. Certain complimentary attributes of NIR data are, therefore, lost in this process of image acquisition. However, RGB and NIR images are captured entirely in two different spectra/wavelengths; thus they retain different information. Since NIR and RGB images compromise complimentary information, we believe that this can be exploited for extracting better features, localization of objects of interest and in multi-modal fusion. In this paper, an attempt is made to estimate the NIR image from a given optical image. Using a normal optical camera and based on the compressed sensing framework, the NIR data estimation is formulated as an image recovery problem. The NIR data is considered as missing pixel information and its approximation is done during the image recovery phase. Thus, for a given optical image, with NIR data being considered as missing information, the recovered NIR data gives the corresponding NIR image. The motivation behind using compressed sensing for NIR estimation is that, it uses a ‘Dictionary Learning Technique’ which is capable of retaining a linear relationship between the color image feature values with NIR data. Using this proposed method, we have been able to estimate NIR images directly from optical images with reconstructed PSNR values ranging from 10 to 20.5 dbs. Visual examination of the estimated data also concurs that there is a good match between the estimated and original NIR images. In the automotive domain, the proposed method would help in a myriad of ADAS applications that use optical cameras viz. night time pedestrian detection, collision avoidance, traffic sign recognition etc.
Recommended Content
Technical Paper | Piloted Studies of Enhanced or Synthetic Vision Display Parameters |
Technical Paper | Vision-Based Techniques for Identifying Emergency Vehicles |
Journal Article | Assessing the Safety of Environment Perception in Automated Driving Vehicles |
Topic
Citation
Danymol, R. and Kutty, K., "A Compressed Sensing and Sparsity Based Approach for Estimating an Equivalent NIR Image from a RGB Image," SAE Technical Paper 2015-01-0310, 2015, https://doi.org/10.4271/2015-01-0310.Also In
References
- Süsstrunk S. and Fredembach C. Enhancing the Visible with the Invisible: Exploiting Near-Infrared to Advance Computational Photography and Computer Vision SID Symposium Digest of Technical Papers 41 1 2010
- Salamati N. , Sadeghipoor Kermani Z. and Süsstrunk S. Compression of Multispectral Images: Color (RGB) plus Near- Infrared (NIR) Procedings of the IEEE 14th International Workshop on Multimedia Signal Processing (MMSP) 65 70 2012
- Brown Matthew and S. Süsstrunk Multi-spectral SIFT for Scene Category Recognition IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 20-25 June 2011
- Fredembach C. and S. Süsstrunk Illuminant Estimation and Detection using Near Infrared Proceedings of Electronic Imaging 7250 January 2009
- Elad Michael Sparse and Redundant Representations:From theory to applications in signal and image processing Springer Publication September 2010
- Aharon Michal , Elad Michael , and Bruckstein Alfred K-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation IEEE Transactions on Signal Processing 54 11 November 2006
- Farsiu Sina , Dirk Robinson M. , Elad Michael , and Milanfar Peyman Fast and robust multiframe super resolution IEEE Transactions on Image processing 13 10 October 2004
- Donoho D. L. Compressed sensing IEEE Transactions on Information Theory 52 4 April 2006
- Candes Emmanuel , Romberg Justin , and Tao Terence Robust Uncertainty Principles: Exact Signal Reconstruction from Highly Incomplete Frequency Information IEEE Transactions on Information Theory 52 2 Feb 2006
- Marco F. Duarte Davenport Mark A. , Takhar Dharmpal , Ting Sun Jason N. Laska , Kelly Kevin F. , Baraniuk Richard G. Single-Pixel Imaging via Compressive Sampling IEEE Signal Processing magazine March 2008
- Baraniuk Richard G. Compressed Sensing IEEE Signal Processing Magazine 24 4 118 121 July 2007
- Images and Visual Representation Group (IVRG) October 10 2014 http://ivrg.epfl.ch/supplementarymaterial/cvpr11/
- Cai T. Tony and Wang Lie Orthogonal Matching Pursuit for Sparse Signal Recovery With Noise IEEE Transactions on Information Theory 57 7 July 2011
- Tropp Joel A. And Gilbert Anna C. Signal Recovery from random measurements Via Orthogonal Matching Pursuit IEEE Transactions on Information Theory 53 12 December 2007
- Rubinstein Ron , Bruckstein Alfred M. , Elad Michael Dictionaries for Sparse Representation Modeling IEEE Proceedings 98 6 June 2010
- Candes E. J. , Eldar Y. C. , Needell D. , and Randall P. Compressed sensing with coherent and redundant dictionaries Applied and Computational Harmonic Analysis Elsevier 31 1 July 2011
- Candes Emmanuel and Romberg Justin Sparsity and Incoherence in Compressive Sampling Journal article, IOP (Institute of Physics) science 10.1088/0266-5611/23/3/008 2007
- Compressed Sensing and Single pixel cameras October 10 2012 http://terrytao.wordpress.com/2007/04/13/compressed-sensing- and-single pixel-cameras/
- Narayanankutty K. A. and Soman K. P. Understanding Theory Behind Compressed Sensing International journal of sensing, computing & control 1 2 80 91 2011