This content is not included in your SAE MOBILUS subscription, or you are not logged in.
Heart-Rate Monitoring Using Single Camera
ISSN: 0148-7191, e-ISSN: 2688-3627
Published March 28, 2017 by SAE International in United States
Annotation ability available
Heart rate is one of the most important biological features for health information. Most of the state-of-the-art heart rate monitoring systems rely on contact technologies that require physical contact with the user. In this paper, we discuss a proof-of-concept of a non-contact technology based on a single camera to measure the user’s heart rate in real time. The algorithm estimates the heart rate based on facial color changes. The input is a series of video frames with the automatically detected face of the user. A Gaussian pyramid spatial filter is applied to the inputs to obtain a down-sampled high signal-to-noise ratio images. A temporal Fourier transform is applied to the video to get the signal spectrum. Next, a temporal band-pass filter is applied to the transformed signal in the frequency domain to extract the frequency band of heart beats. We then used the dominant frequency in the Fourier domain to find the heart rate. Further, an inverse Fourier transform is used on the spectrum to convert the signal back to the time domain. After scaling, the amplified signal is added to the input image to magnify the subtle facial color change that is caused by the heartbeat. We implement on an iPhone 5s using the front facing camera and obtaining a 1.4 beats per minute error when compared to a standard portable heart rate monitor.
CitationLiu, D., Gerardo-Castro, M., Costa, B., and Zhang, Y., "Heart-Rate Monitoring Using Single Camera," SAE Technical Paper 2017-01-1434, 2017, https://doi.org/10.4271/2017-01-1434.
- C. for Disease Control and Prevention, “Heart disease facts sheet,” http://www.cdc.gov/dhdsp/data_statistics/fact_sheets/fs_heart_disease.htm.
- Polar, “Heart disease facts,” http://www.cdc.gov/heartdisease/facts.htm.
- Administration N. H. T. S. , “The contribution of medical conditions to passenger vehicle crashes,” Annals of emergency medicine, vol. 55, no. 6, pp. 563–564, 2010.
- Thayer J. F., Åhs F., Fredrikson M., Sollers J. J., and Wager T. D., “A meta-analysis of heart rate variability and neuroimaging studies: implications for heart rate variability as a marker of stress and health,” Neuroscience & Biobehavioral Reviews, vol. 36, no. 2, pp. 747–756, 2012.
- Choi J. and Gutierrez-Osuna R., “Using heart rate monitors to detect mental stress,” in Wearable and Implantable Body Sensor Networks, 2009. BSN 2009. Sixth International Workshop on. IEEE, 2009, pp. 219–223.
- Lisetti C. L. and Nasoz F., “Affective intelligent car interfaces with emotion recognition,” in Proceedings of 11th International Conference on Human Computer Interaction, Las Vegas, NV, USA. Citeseer,2005.
- Lane R. D., McRae K., Reiman E. M., Chen K., Ahern G. L., and Thayer J. F., “Neural correlates of heart rate variability during emotion,” Neuroimage, vol. 44, no. 1, pp. 213–222, 2009.
- Tsuji H., Larson M. G., Venditti F. J., Manders E. S., Evans J. C., Feldman C. L., and Levy D., “Impact of reduced heart rate variability on risk for cardiac events the framingham heart study,” Circulation, vol. 94, no. 11, pp. 2850–2855, 1996.
- Valancell, “Optical heart rate monitoring: What you need to know,” http://valencell.com/blog/2015/10/optical-heart-rate-monitoring-what-you-need-to-know/.
- Allen J., “Photoplethysmography and its application in clinical physiological measurement,” Physiological measurement, vol. 28, no. 3, p. R1, 2007.
- Droitcour A. D. , “Non-contact measurement of heart and respiration rates with a single-chip microwave doppler radar,” Ph.D. dissertation, Citeseer, 2006.
- Li C., Lubecke V. M., Boric-Lubecke O., and Lin J., “A review on recent advances in doppler radar sensors for noncontact health-care monitoring,” IEEE Transactions on microwave theory and techniques, vol. 61, no. 5, pp. 2046–2060, 2013.
- Adib F., Mao H., Kabelac Z., Katabi D., and Miller R. C., “Smart homes that monitor breathing and heart rate,” in Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM,2015, pp. 837–846.
- Pavlidis I., Dowdall J., Sun N., Puri C., Fei J., and Garbey M., “Interacting with human physiology,” Computer Vision and Image Understanding, vol. 108, no. 1, pp. 150–170, 2007.
- Gatto R. G. , Estimation of instantaneous heart rate using video infrared thermography and ARMA models. UNIVERSITY OF ILLINOIS AT CHICAGO, 2009.
- Garbey M., Sun N., Merla A., and Pavlidis I., “Contact-free measurement of cardiac pulse based on the analysis of thermal imagery,” IEEE Transactions on Biomedical Engineering, vol. 54, no. 8, pp. 1418–1426, 2007.
- Sun N., Pavlidis I., Garbey M., and Fei J., “Harvesting the thermal cardiac pulse signal,” in International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, 2006, pp. 569–576.
- Liu C., Torralba A., Freeman W. T., Durand F., and Adelson E. H., “Motion magnification,” ACM transactions on graphics (TOG), vol. 24, no. 3, pp. 519–526, 2005.
- Poh M.-Z., McDuff D. J., and Picard R. W., “Advancements in noncontact, multiparameter physiological measurements using a webcam,” IEEE transactions on biomedical engineering, vol. 58, no. 1, pp. 7–11, 2011.
- Levin A., Lischinski D., and Weiss Y., “A closed-form solution to natural image matting,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 30, no. 2, pp. 228–242, 2008.
- Wu H.-Y., Rubinstein M., Shih E., Guttag J. V., Durand F., and Freeman W. T., “Eulerian video magnification for revealing subtle changes in the world,” 2012.
- Elgharib M. A., Hefeeda M., Durand F., and Freeman W. T., “Video magnification in presence of large motions,” in 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE,2015, pp. 4119–4127.
- Burt P. and Adelson E., “The laplacian pyramid as a compact image code,” IEEE Transactions on communications, vol. 31, no. 4, pp. 532–540, 1983.
- “All about heart rate (pulse),” http://www.heart.org/HEARTORG/Conditions/More/MyHeartandStrokeNews/All-About-Heart-Rate-Pulse_UCM_438850_Article.jsp#.WIAh-1MrJEY, accessed: 2018-01-18.
- CDC, “Polar move user manual,” http://support.polar.com/e_manuals/Move/Polar_Move_user_manual_English/ch05.html.
- “H7 heart rate sensor,” https://www.polar.com/us-en/products/accessories/H7_heart_rate_sensor, accessed: 2018-01-18.